00000001:02000400:0.0F:1788802021.406517:0:2969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788802040.199489:0:3189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788802042.209229:0:3231:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 407 MB/s 00000001:01000000:3.0:1788802042.461381:0:3231:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 361 MB/s 00000001:01000000:2.0F:1788802042.718601:0:3231:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4198 MB/s 00000020:02000000:3.0:1788802043.691761:0:3280:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gb44c962 00000400:02000000:2.0:1788802044.515114:0:3295:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.157@tcp [8/256/0/180] 00008000:02000000:3.0:1788802048.240710:0:3445:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788802103.668669:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788802116.598279:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788802116.598285:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788802116.598404:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e85da468 00000080:02000400:2.0:1788802116.598415:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788802116.604879:0:5822:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788802116.604895:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788802116.605063:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002ff2aeb3) 00000020:00000080:3.0:1788802116.605084:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788802116.623181:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788802116.623745:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788802116.650506:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788802116.650546:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788802116.650566:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788802116.650617:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788802116.650640:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788802116.650991:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788802116.650999:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788802116.651009:0:5822:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9ba4a 00000020:01000004:3.0:1788802116.651017:0:5822:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788802116.651021:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788802116.651026:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e85da468 from MGS 00000020:01000004:3.0:1788802116.651030:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788802116.651053:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000386c574d) 00000020:00000080:3.0:1788802116.651064:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788802116.651127:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e85da468 from MGS, refs=2 00080000:01000000:3.0:1788802116.651133:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788802116.651139:0:5822:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9ba58 00000100:00100000:3.0:1788802116.651226:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788802116.651398:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788802116.651404:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788802116.652121:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788802116.652128:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788802116.652788:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802116.652944:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788802116.652950:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788802116.653580:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788802116.653587:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788802116.653851:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788802116.653857:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1788802116.656652:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802116.656671:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802116.656674:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802116.657118:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802116.657121:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802116.657122:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802116.658317:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788802116.663774:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788802116.907482:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3835 MB/s 00000001:01000000:2.0:1788802117.161833:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3425 MB/s 00000001:01000000:2.0:1788802117.414203:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 468 MB/s 00000001:01000000:0.0:1788802117.664541:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 892 MB/s 00080000:10000000:0.0:1788802117.673999:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788802117.692321:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788802117.692338:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788802117.692341:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788802117.693049:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788802117.693525:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788802117.693566:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788802117.693764:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788802117.693791:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788802117.694169:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788802117.694376:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788802117.694383:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788802117.699128:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788802117.699144:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788802117.701744:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788802117.701758:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788802117.702359:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788802117.702380:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.157@tcp' 00000020:01000004:0.0:1788802117.702381:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788802117.702428:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.157@tcp (typ=mgc) 00000020:00000080:0.0:1788802117.702446:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.157@tcp (0000000048cc623e) 00000020:00000080:0.0:1788802117.702468:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788802117.702585:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004a33acbb@MGC192.168.201.157@tcp: add connection 192.168.201.157@tcp at head 00010000:00010000:0.0:1788802117.703132:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.157@tcp-0 is initialized 00000040:01000000:0.0:1788802117.703140:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788802117.707195:0:5838:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788802117.707523:0:5840:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788802117.707563:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.157@tcp (uuid dcb700dc-e7bb-457d-b553-2dc4634087c8) 00000020:00000080:0.0:1788802117.707587:0:5822:0:(genops.c:1384:class_connect()) connect: client dcb700dc-e7bb-457d-b553-2dc4634087c8, cookie 0x6ecba1490fc9ba66 00000100:00080000:0.0:1788802117.707600:0:5822:0:(import.c:545:import_select_connection()) MGC192.168.201.157@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788802117.707608:0:5822:0:(import.c:666:import_select_connection()) MGC192.168.201.157@tcp: import 000000004a33acbb using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788802117.707652:0:5822:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005d4eb463 x1875694892089472/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788802117.707677:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dcb700dc-e7bb-457d-b553-2dc4634087c8->MGS 00000100:00100000:1.0:1788802117.708830:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d4eb463 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dcb700dc-e7bb-457d-b553-2dc4634087c8:3310:1875694892089472:0@lo:250: 00000100:00100000:1.0:1788802117.708893:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802117.709614:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892089472 00000100:00100000:1.0:1788802117.709623:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892089472 00000100:00100000:1.0:1788802117.709672:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802117.709678:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7a953e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1875694892089472:12345-0@lo:250: 00010000:00080000:1.0:1788802117.709704:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from dcb700dc-e7bb-457d-b553-2dc4634087c8@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1788802117.709729:0:5834:0:(genops.c:1384:class_connect()) connect: client dcb700dc-e7bb-457d-b553-2dc4634087c8, cookie 0x6ecba1490fc9ba6d 00000100:00080000:1.0:1788802117.709857:0:5834:0:(import.c:65:import_set_state_nolock()) 00000000f656c785 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788802117.709912:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7a953e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:3310:x1875694892089472:12345-0@lo:250: Request processed in 233us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802117.709920:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802117.710078:0:3310:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.157@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788802117.710087:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.157@tcp: connect to target with instance 0 00000100:00080000:1.0:1788802117.710094:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.157@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788802117.710098:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788802117.710101:0:3310:0:(import.c:65:import_set_state_nolock()) 000000004a33acbb MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788802117.710103:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788802117.710106:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788802117.710111:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d4eb463 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dcb700dc-e7bb-457d-b553-2dc4634087c8:3310:1875694892089472:0@lo:250: 00000020:01000004:0.0:1788802117.718543:0:5822:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00010000:00010000:0.0:1788802117.718602:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788802117.718740:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788802117.718779:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006c0eed06) 00000020:00000080:2.0:1788802117.718801:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788802117.750193:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788802117.750746:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788802117.750753:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788802117.752070:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788802117.752083:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788802117.758705:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788802117.758721:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788802117.759797:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802117.759998:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788802117.760003:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788802117.760538:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788802117.760545:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788802117.859312:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788802117.859541:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788802117.859548:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788802117.864635:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788802117.864657:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788802117.866817:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802117.867082:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788802117.867089:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788802117.867919:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788802117.867993:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788802117.869379:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802117.869561:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788802117.869567:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788802117.870171:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788802117.870178:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788802117.871182:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802117.873558:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788802117.873567:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788802117.878908:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788802117.878924:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788802117.904755:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788802117.904974:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788802117.904980:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788802117.914666:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788802117.914685:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788802117.915700:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788802117.915710:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788802117.918025:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788802117.918052:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788802117.918058:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788802117.918211:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788802117.920429:0:5822:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.157@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788802117.920437:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788802117.920439:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788802117.920441:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788802117.920442:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788802117.920443:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788802117.920455:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788802117.920456:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788802117.920457:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788802117.920459:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788802117.920460:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788802117.920462:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788802117.920463:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788802117.920467:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788802117.920469:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788802117.920470:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788802117.920471:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788802117.920472:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788802117.920472:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788802117.920473:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788802117.920474:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788802117.920475:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788802117.920475:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788802117.920476:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788802117.920477:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788802117.920478:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788802117.920535:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788802117.920554:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892089600:0@lo:253: 00000100:00100000:3.0:1788802117.920641:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802117.920693:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dc8b126 going to sleep for 11 seconds 00000100:00100000:0.0:1788802117.920700:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892089600 00000100:00100000:0.0:1788802117.920710:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892089600 00000100:00100000:0.0:1788802117.920762:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788802117.920770:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5cb2f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:5822:x1875694892089600:12345-0@lo:253: 20000000:01000000:0.0:1788802117.920819:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788802117.920822:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788802117.921533:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788802117.921591:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788802117.921878:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788802117.924591:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788802117.925456:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788802117.925462:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788802117.925467:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788802117.925471:0:5837:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788802117.925486:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788802117.925722:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788802117.929382:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788802117.929413:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788802117.929483:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788802117.929536:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788802117.929575:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788802117.929707:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788802117.929715:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788802117.929758:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788802117.929767:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788802117.929797:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788802117.929804:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788802117.929834:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788802117.929913:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788802117.929952:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788802117.929958:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788802117.929970:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788802117.930186:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788802117.930196:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788802117.930426:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788802117.930462:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788802117.930522:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788802117.930535:0:5837:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788802117.930609:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788802117.930617:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788802117.930659:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788802117.930696:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788802117.930726:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788802117.930736:0:5837:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788802117.930814:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788802117.930823:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788802117.930915:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788802117.930956:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788802117.931140:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788802117.931184:0:5837:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788802117.931192:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788802117.936904:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788802117.937771:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788802117.937815:0:5837:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.157@tcp for mdt 20000000:01000000:2.0:1788802117.937817:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.157@tcp (null) (null) (null) 00000040:00080000:2.0:1788802117.938835:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788802117.938848:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788802117.938904:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788802117.938912:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.157@tcp (null) (null) 00000040:00080000:2.0:1788802117.938976:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788802117.938988:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788802117.939035:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788802117.939094:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788802117.939179:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788802117.939183:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788802117.939188:0:5837:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788802117.939195:0:5837:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788802117.940578:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788802117.940757:0:5837:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788802117.955752:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788802117.955806:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788802117.956065:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788802117.956087:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788802117.956090:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788802117.956094:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788802117.956110:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788802117.956112:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788802117.956148:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788802117.956150:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788802117.957660:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788802117.958187:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788802117.958612:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1788802117.958699:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1788802117.958722:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788802117.958725:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788802117.960700:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788802117.961161:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788802117.961208:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788802117.961280:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788802117.961300:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788802117.961302:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788802117.961310:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788802117.961329:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802117.961346:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802117.961356:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802117.961363:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802117.961369:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802117.961375:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802117.961381:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000059edd7d5 already unused, calling callback (00000000f05f20b9) 00010000:00010000:3.0:1788802117.961385:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802117.961392:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802117.961421:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802117.961429:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802117.961435:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000059edd7d5/0x6ecba1490fc9ba7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788802117.961452:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788802118.429844:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5cb2f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:5822:x1875694892089600:12345-0@lo:253: Request processed in 509062us (509190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802118.429872:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788802118.430075:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892089600:0@lo:253: 10000000:01000000:3.0:1788802118.430095:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788802118.430099:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788802118.430101:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788802118.430103:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788802118.430105:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788802118.430107:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788802118.430108:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788802118.430109:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788802118.430111:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788802118.430113:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788802118.430114:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788802118.430116:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788802118.430144:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e85da468 from lustre-MDT0000 10000000:01000000:3.0:1788802118.430177:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788802118.430181:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788802118.430186:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff910d10cbcd40 10000000:01000000:3.0:1788802118.430192:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788802118.430201:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff910d10cbcd40 from 1 10000000:01000000:3.0:1788802118.430205:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788802118.430273:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 0000000059edd7d5/0x6ecba1490fc9ba82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.430297:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 0000000059edd7d5/0x6ecba1490fc9ba82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.430309:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 0000000059edd7d5/0x6ecba1490fc9ba82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802118.430330:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892089728:0@lo:101: 00000100:00100000:3.0:1788802118.430384:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802118.430448:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f59d263 going to sleep for 11 seconds 00000100:00100000:0.0:1788802118.430584:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892089728 00000100:00100000:0.0:1788802118.430593:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892089728 00000100:00100000:0.0:1788802118.430640:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788802118.430648:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065d9e169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:5822:x1875694892089728:12345-0@lo:101: 00010000:00010000:0.0:1788802118.430671:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802118.430686:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000186a8507/0x6ecba1490fc9ba89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9ba82 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802118.430722:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000186a8507/0x6ecba1490fc9ba89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9ba82 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802118.430732:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000186a8507/0x6ecba1490fc9ba89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ba82 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802118.430741:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000186a8507, rc 0) 00000100:00100000:0.0:1788802118.430789:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065d9e169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+6:5822:x1875694892089728:12345-0@lo:101: Request processed in 143us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802118.430795:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788802118.430908:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892089728:0@lo:101: 00010000:00010000:3.0:1788802118.430920:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 0000000059edd7d5/0x6ecba1490fc9ba82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.430939:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 0000000059edd7d5/0x6ecba1490fc9ba82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802118.430987:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892089856:0@lo:501: 00000100:00100000:3.0:1788802118.431020:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802118.431033:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f59d263 going to sleep for 11 seconds 00000100:00100000:2.0:1788802118.431136:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892089856 00000100:00100000:2.0:1788802118.431140:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892089856 00000100:00100000:2.0:1788802118.431167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788802118.431172:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000074a52288 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+6:5822:x1875694892089856:12345-0@lo:501: 00000100:00100000:2.0:1788802118.431460:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000074a52288 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+6:5822:x1875694892089856:12345-0@lo:501: Request processed in 288us (440us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788802118.431467:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788802118.431543:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892089856:0@lo:501: 10000000:01000000:3.0:1788802118.431571:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788802118.431590:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 0000000059edd7d5/0x6ecba1490fc9ba82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.431599:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 0000000059edd7d5/0x6ecba1490fc9ba82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802118.431618:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910d054ea800 10000000:01000000:3.0:1788802118.431622:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788802118.431627:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff910d054ea800 10000000:01000000:3.0:1788802118.431629:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788802118.431632:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff910d054ea800 from 1 10000000:01000000:3.0:1788802118.431635:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788802118.431651:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 000000000f865cb8/0x6ecba1490fc9ba90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.431658:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 000000000f865cb8/0x6ecba1490fc9ba90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.431676:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 000000000f865cb8/0x6ecba1490fc9ba90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802118.431687:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892089984:0@lo:101: 00000100:00100000:3.0:1788802118.431709:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802118.431730:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f59d263 going to sleep for 11 seconds 00000100:00100000:3.0:1788802118.431748:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892089984 00000100:00100000:3.0:1788802118.431752:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892089984 00000100:00100000:3.0:1788802118.431769:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788802118.431773:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e22ac2a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+6:5822:x1875694892089984:12345-0@lo:101: 00010000:00010000:3.0:1788802118.431780:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802118.431790:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000084516a52/0x6ecba1490fc9ba97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9ba90 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.431804:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084516a52/0x6ecba1490fc9ba97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9ba90 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.431822:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000084516a52/0x6ecba1490fc9ba97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ba90 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.431829:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000084516a52, rc 0) 00000100:00100000:3.0:1788802118.431851:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e22ac2a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+7:5822:x1875694892089984:12345-0@lo:101: Request processed in 78us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802118.431856:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788802118.431883:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892089984:0@lo:101: 00010000:00010000:3.0:1788802118.431891:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 000000000f865cb8/0x6ecba1490fc9ba90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.431898:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 000000000f865cb8/0x6ecba1490fc9ba90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802118.431907:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788802118.431909:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 000000000f865cb8/0x6ecba1490fc9ba90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.431916:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 000000000f865cb8/0x6ecba1490fc9ba90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802118.431921:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788802118.432036:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788802118.432041:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff910d054ea800 10000000:01000000:3.0:1788802118.432044:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788802118.432046:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788802118.432048:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788802118.432060:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 00000000c3d13d61/0x6ecba1490fc9ba9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.432070:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 00000000c3d13d61/0x6ecba1490fc9ba9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.432078:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 00000000c3d13d61/0x6ecba1490fc9ba9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802118.432088:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892090112:0@lo:101: 00000100:00100000:3.0:1788802118.432110:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802118.432121:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f59d263 going to sleep for 11 seconds 00000100:00100000:3.0:1788802118.432132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892090112 00000100:00100000:3.0:1788802118.432135:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892090112 00000100:00100000:3.0:1788802118.432148:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788802118.432153:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007c73d053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+7:5822:x1875694892090112:12345-0@lo:101: 00010000:00010000:3.0:1788802118.432159:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802118.432164:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ab64a75/0x6ecba1490fc9baa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9ba9e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.432174:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ab64a75/0x6ecba1490fc9baa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9ba9e expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.432182:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ab64a75/0x6ecba1490fc9baa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ba9e expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.432188:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ab64a75, rc 0) 00000100:00100000:3.0:1788802118.432209:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007c73d053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+8:5822:x1875694892090112:12345-0@lo:101: Request processed in 56us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802118.432214:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788802118.432269:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892090112:0@lo:101: 00010000:00010000:3.0:1788802118.432284:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 00000000c3d13d61/0x6ecba1490fc9ba9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802118.432290:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 00000000c3d13d61/0x6ecba1490fc9ba9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802118.432325:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892090240:0@lo:501: 00000100:00100000:3.0:1788802118.432350:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802118.432368:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f59d263 going to sleep for 11 seconds 00000100:00100000:3.0:1788802118.432380:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892090240 00000100:00100000:3.0:1788802118.432384:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892090240 00000100:00100000:3.0:1788802118.432402:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788802118.432407:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8c1f692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+8:5822:x1875694892090240:12345-0@lo:501: 00000100:00100000:3.0:1788802118.432608:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8c1f692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:5822:x1875694892090240:12345-0@lo:501: Request processed in 201us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802118.432614:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788802118.432637:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892090240:0@lo:501: 00000100:00100000:3.0:1788802118.432800:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892090368:0@lo:503: 00000100:00100000:3.0:1788802118.432838:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802118.432861:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000003f59d263 going to sleep for 11 seconds 00000100:00100000:2.0:1788802118.432942:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892090368 00000100:00100000:2.0:1788802118.432947:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892090368 00000100:00100000:2.0:1788802118.432978:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788802118.432982:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac020dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:5822:x1875694892090368:12345-0@lo:503: 00000100:00100000:2.0:1788802118.433161:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac020dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:5822:x1875694892090368:12345-0@lo:503: Request processed in 179us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802118.433168:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788802118.433376:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892090368:0@lo:503: 00000100:00100000:3.0:1788802118.433894:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:5866:1875694892090496:0@lo:502: 00000100:00100000:3.0:1788802118.434017:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802118.434064:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d18b8c5d going to sleep for 11 seconds 00000100:00100000:2.0:1788802118.434133:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892090496 00000100:00100000:2.0:1788802118.434140:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892090496 00000100:00100000:2.0:1788802118.434236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788802118.434280:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003071073c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:5866:x1875694892090496:12345-0@lo:502: 00000100:00100000:2.0:1788802118.434493:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003071073c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:5866:x1875694892090496:12345-0@lo:502: Request processed in 215us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802118.434501:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788802118.434692:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:5866:1875694892090496:0@lo:502: 00000020:01000000:3.0:1788802118.434726:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788802118.434747:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802118.434750:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788802118.434757:0:5866:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788802118.434761:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788802118.434778:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000558ae11c) 00000020:00000080:3.0:1788802118.434798:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788802118.434804:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788802118.434897:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788802118.434905:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9bab3 00000020:00000080:3.0:1788802118.435207:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788802118.435212:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802118.435216:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802118.435217:0:5866:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788802118.435220:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788802118.435223:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802118.435224:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788802118.435227:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788802118.435234:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b07e860b) 00000020:00000080:3.0:1788802118.435271:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788802118.435276:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788802118.435279:0:5866:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788802118.435282:0:5866:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788802118.435289:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788802118.435347:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e85da468 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788802118.435371:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000bda38da3) 00000020:00000080:3.0:1788802118.435379:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788802118.435441:0:5866:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788802118.435447:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6ecba1490fc9bac8 00000020:00000080:3.0:1788802118.435544:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788802118.435551:0:5866:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788802118.435555:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6ecba1490fc9bacf 00080000:01000000:3.0:1788802118.435559:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788802118.435563:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9bad6 00080000:10000000:3.0:1788802118.436060:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788802118.436358:0:5866:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788802118.440370:0:5866:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788802118.555627:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788802118.557159:0:5866:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788802118.563100:0:5866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788802118.563966:0:5866:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788802118.639542:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c0a4aa18) 00000020:00000080:3.0:1788802118.639574:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788802118.639676:0:5866:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788802118.639685:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9bae4 00000020:00000080:2.0:1788802118.645615:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788802118.650160:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00010000:00010000:1.0:1788802118.737524:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788802118.751553:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788802118.857840:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788802118.948114:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788802119.000151:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788802119.034787:0:5866:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788802119.085202:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6ecba1490fc9baeb 00000020:00000080:2.0:1788802119.085792:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788802119.085806:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802119.085813:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802119.085815:0:5866:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788802119.085819:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802119.085825:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802119.085827:0:5866:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788802119.085831:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788802119.085874:0:5866:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788802119.085895:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802119.085898:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802119.085899:0:5866:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788802119.085901:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802119.085904:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802119.085905:0:5866:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788802119.085908:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788802119.085909:0:5866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788802119.086090:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:5866:1875694892090624:0@lo:502: 00000100:00100000:2.0:1788802119.086193:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802119.086338:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892090624 00000100:00100000:0.0:1788802119.086348:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892090624 00000100:00100000:0.0:1788802119.086452:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788802119.086462:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000061e45666 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:5866:x1875694892090624:12345-0@lo:502: 00000100:00100000:2.0:1788802119.086785:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8734e64 going to sleep for 11 seconds 00000100:00100000:0.0:1788802119.087143:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000061e45666 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:5866:x1875694892090624:12345-0@lo:502: Request processed in 681us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802119.087151:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788802119.087258:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:5866:1875694892090624:0@lo:502: 00000020:01000000:2.0:1788802119.087290:0:5866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802119.087297:0:5866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802119.087300:0:5866:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788802119.087304:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788802119.087585:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788802119.087606:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788802119.087627:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 00000000c3d13d61/0x6ecba1490fc9ba9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.087641:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 00000000c3d13d61/0x6ecba1490fc9ba9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802119.087787:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff910d054ea800 from 1 10000000:01000000:3.0:1788802119.087791:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788802119.087832:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.087840:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.087850:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802119.087869:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892090752:0@lo:101: 00000100:00100000:3.0:1788802119.087909:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802119.088091:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c37d0db9 going to sleep for 11 seconds 00000100:00100000:1.0:1788802119.088178:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892090752 00000100:00100000:1.0:1788802119.088185:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892090752 00000100:00100000:1.0:1788802119.088217:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788802119.088224:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a18682 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:5822:x1875694892090752:12345-0@lo:101: 00010000:00010000:1.0:1788802119.088249:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802119.088265:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001a42600c/0x6ecba1490fc9baf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9baf2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802119.088290:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a42600c/0x6ecba1490fc9baf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9baf2 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802119.088301:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001a42600c/0x6ecba1490fc9baf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9baf2 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802119.088310:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001a42600c, rc 0) 00000100:00100000:1.0:1788802119.088351:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a18682 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:5822:x1875694892090752:12345-0@lo:101: Request processed in 124us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802119.088358:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788802119.088403:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892090752:0@lo:101: 00010000:00010000:3.0:1788802119.088421:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.088433:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802119.089133:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892090880:0@lo:256: 00000100:00100000:3.0:1788802119.089189:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802119.089225:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c37d0db9 going to sleep for 11 seconds 00000100:00100000:1.0:1788802119.089264:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892090880 00000100:00100000:1.0:1788802119.089270:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892090880 00000100:00100000:1.0:1788802119.089350:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788802119.089364:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ef81856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:5822:x1875694892090880:12345-0@lo:256: 20000000:01000000:1.0:1788802119.089381:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788802119.089388:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788802119.089468:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ef81856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:5822:x1875694892090880:12345-0@lo:256: Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802119.089475:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788802119.089513:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892090880:0@lo:256: 10000000:01000000:3.0:1788802119.090333:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788802119.090357:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.090373:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802119.090423:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d054ea800 from 1 10000000:01000000:2.0:1788802119.090429:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788802119.090468:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.090477:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.090487:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802119.090506:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091008:0@lo:101: 00000100:00100000:2.0:1788802119.090626:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802119.090767:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000037eb757 going to sleep for 11 seconds 00000100:00100000:0.0:1788802119.090812:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892091008 00000100:00100000:0.0:1788802119.090820:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892091008 00000100:00100000:0.0:1788802119.090864:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788802119.090871:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009ed4f97f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:5822:x1875694892091008:12345-0@lo:101: 00010000:00010000:0.0:1788802119.090882:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802119.090898:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000848bd6c0/0x6ecba1490fc9bb07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bb00 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802119.090930:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000848bd6c0/0x6ecba1490fc9bb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb00 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802119.090952:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000848bd6c0/0x6ecba1490fc9bb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb00 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802119.090960:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000848bd6c0, rc 0) 00000100:00100000:0.0:1788802119.091041:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009ed4f97f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:5822:x1875694892091008:12345-0@lo:101: Request processed in 170us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802119.091047:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788802119.091163:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091008:0@lo:101: 00010000:00010000:2.0:1788802119.091175:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.091184:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802119.091265:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091136:0@lo:501: 00000100:00100000:2.0:1788802119.091288:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802119.091312:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000037eb757 going to sleep for 11 seconds 00000100:00100000:1.0:1788802119.091361:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892091136 00000100:00100000:1.0:1788802119.091365:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892091136 00000100:00100000:1.0:1788802119.091390:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788802119.091396:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006c91f909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:5822:x1875694892091136:12345-0@lo:501: 00000100:00100000:1.0:1788802119.092284:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006c91f909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:5822:x1875694892091136:12345-0@lo:501: Request processed in 886us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802119.092294:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788802119.092474:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091136:0@lo:501: 00000100:00100000:2.0:1788802119.092514:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091264:0@lo:503: 00000100:00100000:2.0:1788802119.092624:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802119.092751:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000037eb757 going to sleep for 11 seconds 00000100:00100000:0.0:1788802119.092783:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892091264 00000100:00100000:0.0:1788802119.092789:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892091264 00000100:00100000:0.0:1788802119.092821:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788802119.092827:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d89de0c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:5822:x1875694892091264:12345-0@lo:503: 00000040:00080000:0.0:1788802119.092869:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788802119.093005:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d89de0c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:5822:x1875694892091264:12345-0@lo:503: Request processed in 178us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802119.093013:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788802119.093074:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091264:0@lo:503: 00000040:00080000:1.0:1788802119.094806:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788802119.095143:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788802119.095168:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788802119.095221:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.095235:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802119.095330:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788802119.095333:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910d054ea800 10000000:01000000:2.0:1788802119.095336:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910d054ea800 10000000:01000000:2.0:1788802119.095340:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788802119.095347:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d054ea800 from 1 10000000:01000000:2.0:1788802119.095364:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788802119.095408:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 0000000052680e33/0x6ecba1490fc9bb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.095416:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 0000000052680e33/0x6ecba1490fc9bb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.095429:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 0000000052680e33/0x6ecba1490fc9bb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802119.095456:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091392:0@lo:101: 00000100:00100000:2.0:1788802119.095531:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802119.095715:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892091392 00000100:00100000:0.0:1788802119.095724:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892091392 00000100:00100000:0.0:1788802119.095822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788802119.095831:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c731688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:5822:x1875694892091392:12345-0@lo:101: 00010000:00010000:0.0:1788802119.095844:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802119.095858:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a5e9a628/0x6ecba1490fc9bb15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bb0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802119.095883:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5e9a628/0x6ecba1490fc9bb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb0e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802119.095893:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a5e9a628/0x6ecba1490fc9bb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb0e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802119.095909:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a5e9a628, rc 0) 00000100:00100000:0.0:1788802119.096084:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c731688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5822:x1875694892091392:12345-0@lo:101: Request processed in 253us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802119.096091:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788802119.096221:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000609fdc2c going to sleep for 11 seconds 00000100:00100000:2.0:1788802119.096413:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091392:0@lo:101: 00010000:00010000:2.0:1788802119.096429:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 0000000052680e33/0x6ecba1490fc9bb0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.096439:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 0000000052680e33/0x6ecba1490fc9bb0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802119.096503:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091520:0@lo:501: 00000100:00100000:2.0:1788802119.096532:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802119.097138:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000609fdc2c going to sleep for 11 seconds 00000100:00100000:0.0:1788802119.097187:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892091520 00000100:00100000:0.0:1788802119.097195:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892091520 00000100:00100000:0.0:1788802119.097404:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788802119.097413:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c6111780 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5822:x1875694892091520:12345-0@lo:501: 00000100:00100000:0.0:1788802119.098109:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c6111780 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5822:x1875694892091520:12345-0@lo:501: Request processed in 693us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802119.098119:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788802119.098512:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091520:0@lo:501: 00000100:00100000:2.0:1788802119.098646:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091648:0@lo:503: 00000100:00100000:2.0:1788802119.098775:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802119.098855:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000609fdc2c going to sleep for 11 seconds 00000100:00100000:0.0:1788802119.098985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892091648 00000100:00100000:0.0:1788802119.099001:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892091648 00000100:00100000:0.0:1788802119.099044:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788802119.099052:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000019df1ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5822:x1875694892091648:12345-0@lo:503: 00000100:00100000:0.0:1788802119.099785:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000019df1ee8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5822:x1875694892091648:12345-0@lo:503: Request processed in 731us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802119.099796:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788802119.100172:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892091648:0@lo:503: 00000100:00100000:1.0:1788802119.100765:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e317d215 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:5871:1875694892091776:0@lo:502: 00000100:00100000:1.0:1788802119.100827:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802119.100909:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 0000000048f5a0f4 going to sleep for 11 seconds 00000100:00100000:0.0:1788802119.101063:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892091776 00000100:00100000:0.0:1788802119.101071:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892091776 00000100:00100000:0.0:1788802119.101159:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788802119.101168:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8454699 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5871:x1875694892091776:12345-0@lo:502: 00000100:00100000:0.0:1788802119.101511:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8454699 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5871:x1875694892091776:12345-0@lo:502: Request processed in 344us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802119.101519:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788802119.101780:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e317d215 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:5871:1875694892091776:0@lo:502: 00000020:01000004:1.0:1788802119.101858:0:5871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788802119.101890:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000000521dac0) 00000020:00000080:1.0:1788802119.101923:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788802119.102027:0:5871:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e85da468 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788802119.102031:0:5871:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e85da468 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788802119.102034:0:5871:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e85da468 4 00010000:00080000:1.0:1788802119.102069:0:5871:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000225b8770@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:1.0:1788802119.105069:0:5871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788802119.105329:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788802119.105388:0:5871:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788802119.105404:0:5871:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6ecba1490fc9bb23 00000100:00080000:1.0:1788802119.105418:0:5871:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788802119.105431:0:5871:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000225b8770 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788802119.105483:0:5871:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e317d215 x1875694892091904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788802119.105531:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e317d215 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875694892091904:0@lo:38: 00000100:00100000:1.0:1788802119.110162:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802119.110298:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892091904 00000100:00100000:1.0:1788802119.110310:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892091904 00000100:00100000:1.0:1788802119.110348:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802119.110356:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7074f21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875694892091904:12345-0@lo:38: 00000100:00100000:1.0:1788802119.110420:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7074f21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875694892091904:12345-0@lo:38: Request processed in 64us (268us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788802119.110427:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802119.110470:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788802119.110480:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000225b8770 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788802119.110504:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788802119.110508:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e317d215 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875694892091904:0@lo:38: 00000100:00080000:1.0:1788802119.110527:0:5871:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788802119.113646:0:5871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:5871:1875694892092032:0@lo:502: 00000100:00100000:3.0:1788802119.113772:0:5871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802119.113815:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892092032 00000100:00100000:3.0:1788802119.113825:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892092032 00000100:00100000:3.0:1788802119.114702:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788802119.114714:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009df6035b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5871:x1875694892092032:12345-0@lo:502: 00000100:00100000:3.0:1788802119.115268:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009df6035b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5871:x1875694892092032:12345-0@lo:502: Request processed in 555us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802119.115278:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788802119.115359:0:5871:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c37d0db9 going to sleep for 11 seconds 00000100:00100000:3.0:1788802119.115389:0:5871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:5871:1875694892092032:0@lo:502: 00000040:00080000:3.0:1788802119.115431:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788802119.115662:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788802119.115697:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788802119.115718:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 0000000052680e33/0x6ecba1490fc9bb0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802119.115730:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 0000000052680e33/0x6ecba1490fc9bb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788802119.115785:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788802119.115788:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788802119.115789:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788802119.115790:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788802119.115791:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788802119.115793:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788802119.115794:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788802119.115795:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788802119.115797:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788802119.115798:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788802119.115800:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788802119.115802:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788802119.115806:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788802119.115809:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788802119.115811:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788802119.115812:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788802119.115813:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788802119.115814:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788802119.115815:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788802119.115816:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788802119.115817:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788802119.115818:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788802119.115818:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788802119.115819:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788802119.115820:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788802119.115856:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788802119.115872:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0ad7edf pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892092160:0@lo:253: 00000100:00100000:0.0:1788802119.115931:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802119.115953:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018dbcd29 going to sleep for 11 seconds 00000100:00100000:0.0:1788802119.115974:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892092160 00000100:00100000:0.0:1788802119.115985:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892092160 00000100:00100000:0.0:1788802119.116029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788802119.116034:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bee30cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5822:x1875694892092160:12345-0@lo:253: 20000000:01000000:0.0:1788802119.116059:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788802119.116074:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788802119.251352:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788802119.251379:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788802119.251507:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788802119.251514:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788802119.251545:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802119.251570:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001a42600c/0x6ecba1490fc9baf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9baf2 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802119.251603:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802119.251718:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001a42600c/0x6ecba1490fc9baf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9baf2 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802119.251737:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001a42600c/0x6ecba1490fc9baf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9baf2 expref: 12 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802119.251757:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e317d215 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875694892092288:0@lo:104: 00000100:00100000:1.0:1788802119.251837:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802119.251953:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000002584f6d8 going to sleep for 11 seconds 00000100:00100000:2.0:1788802119.258316:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892092288 00000100:00100000:2.0:1788802119.258336:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892092288 00000100:00100000:2.0:1788802119.258406:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788802119.258416:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000043a689 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5858:x1875694892092288:12345-0@lo:104: 00010000:00010000:2.0:1788802119.258441:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.258578:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788802119.258585:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000043a689 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5858:x1875694892092288:12345-0@lo:104: Request processed in 170us (6749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802119.258593:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788802119.258677:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e317d215 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875694892092288:0@lo:104: 00010000:00010000:2.0:1788802119.258712:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.258735:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802119.258741:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.258748:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c2da51d2 already unused, calling callback (000000006ff4c7b6) 10000000:00010000:2.0:1788802119.258752:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.258760:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788802119.258768:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802119.258790:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788802119.258836:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.258842:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788802119.258868:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.258875:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9baf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9baf9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802119.258893:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802119.258895:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802119.258896:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802119.266220:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788802119.266287:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892092416:0@lo:103: 00000100:00100000:2.0:1788802119.266378:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802119.266794:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892092416 00000100:00100000:3.0:1788802119.266807:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892092416 00010000:00010000:3.0:1788802119.266851:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001a42600c/0x6ecba1490fc9baf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9baf2 expref: 13 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802119.266900:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788802119.266909:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6ff87a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:3311:x1875694892092416:12345-0@lo:103: 00010000:00010000:3.0:1788802119.266926:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802119.266931:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001a42600c/0x6ecba1490fc9baf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9baf2 expref: 13 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.266944:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001a42600c/0x6ecba1490fc9baf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9baf2 expref: 13 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.266965:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001a42600c/0x6ecba1490fc9baf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9baf2 expref: 13 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.266983:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.267004:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788802119.267023:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015510613s 00010000:00010000:3.0:1788802119.267027:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.267034:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.267055:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.267063:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.267069:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008cc00e70 already unused, calling callback (00000000f05f20b9) 00010000:00010000:3.0:1788802119.267073:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.267082:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.267106:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802119.267118:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802119.267167:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6ff87a6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:3311:x1875694892092416:12345-0@lo:103: Request processed in 260us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802119.267175:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788802119.267389:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802119.267399:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802119.267405:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008cc00e70/0x6ecba1490fc9bb2a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802119.267664:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892092416:0@lo:103: 00000100:00100000:2.0:1788802119.289851:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bee30cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:5822:x1875694892092160:12345-0@lo:253: Request processed in 173805us (173908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802119.289871:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788802119.290003:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0ad7edf pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:5822:1875694892092160:0@lo:253: 10000000:01000000:0.0:1788802119.290024:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788802119.290027:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788802119.290029:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788802119.290031:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788802119.290032:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788802119.290033:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788802119.290034:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788802119.290035:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788802119.290037:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788802119.290038:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788802119.290039:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788802119.290041:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788802119.290043:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788802119.290061:0:5822:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788802119.298813:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788802119.299524:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788802119.299848:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788802119.300450:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788802119.300800:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788802119.301036:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788802119.302412:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788802119.302578:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788802119.315516:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788802119.315782:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788802119.319116:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788802119.321139:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788802119.363506:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788802119.402620:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788802119.402886:0:5877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1788802119.405097:0:5876:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788802119.405106:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788802119.405882:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788802119.406331:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788802119.406722:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788802119.406730:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788802119.406882:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788802119.408210:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788802119.408761:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788802119.408797:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788802119.409938:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788802119.410374:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788802119.412806:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788802119.413029:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788802119.413182:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788802119.413459:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788802119.413603:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788802119.413749:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788802119.413892:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788802119.414450:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788802119.414587:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788802119.414802:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788802119.415081:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788802119.415285:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788802119.415435:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788802119.415594:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788802119.415806:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788802119.416086:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788802119.416326:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788802119.416556:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788802119.416769:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788802119.417111:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788802119.418063:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788802119.418221:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788802119.418762:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788802119.419219:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788802119.419398:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788802119.419557:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788802119.419700:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788802119.419857:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788802119.423041:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788802119.423219:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788802119.423443:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788802119.423568:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788802119.423809:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788802119.455058:0:5877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788802119.511402:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788802119.511452:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafe641c9f988 00100000:10000000:2.0:1788802119.511472:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788802119.512478:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788802119.512506:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788802119.512521:0:5822:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788802119.512543:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788802119.567901:0:5877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788802119.568648:0:5877:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788802119.568654:0:5877:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788802119.758274:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802120.781287:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802121.813673:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802122.828427:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802123.853194:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788802124.174089:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788802124.174100:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788802124.174104:0:8:0:(import.c:65:import_set_state_nolock()) 00000000225b8770 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788802124.174137:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000225b8770 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788802124.174647:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000011dffd47 x1875694892092672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788802124.174936:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788802124.174956:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f05c8ac7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892092544:0@lo:400: 00000100:00100000:0.0:1788802124.175057:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802124.175444:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000011dffd47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875694892092672:0@lo:38: 00000100:00100000:1.0:1788802124.175484:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802124.175939:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892092544 00000100:00100000:0.0:1788802124.175951:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892092544 00000100:00100000:0.0:1788802124.176004:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788802124.176013:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ac52d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:3314:x1875694892092544:12345-0@lo:400: 00000100:00100000:0.0:1788802124.176084:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ac52d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:3314:x1875694892092544:12345-0@lo:400: Request processed in 72us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802124.176092:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788802124.176185:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f05c8ac7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892092544:0@lo:400: 00000100:00100000:2.0:1788802124.189419:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892092672 00000100:00100000:2.0:1788802124.189443:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892092672 00000100:00100000:2.0:1788802124.189498:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788802124.189507:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058930f1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875694892092672:12345-0@lo:38: 00010000:00080000:2.0:1788802124.189545:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:2.0:1788802124.189603:0:5844:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6ecba1490fc9bb31 00000004:00100000:2.0:1788802124.189666:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788802124.189863:0:5844:0:(import.c:65:import_set_state_nolock()) 000000001d70d4fa : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788802124.189998:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058930f1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875694892092672:12345-0@lo:38: Request processed in 491us (14512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802124.190007:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788802124.190090:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000011dffd47 x1875694892092672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788802134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788802124.190110:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788802124.190119:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788802124.190124:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788802124.190127:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000225b8770 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788802124.190133:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000011dffd47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875694892092672:0@lo:38: 00010000:00010000:2.0:1788802124.881512:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788802125.713297:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788802125.713313:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff910d054ea800 from 3 10000000:01000000:3.0:1788802125.713318:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788802125.713358:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9bb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802125.713371:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9bb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802125.713382:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9bb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802125.713404:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892092800:0@lo:101: 00000100:00100000:3.0:1788802125.713471:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802125.713509:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8e98a9d going to sleep for 11 seconds 00000100:00100000:2.0:1788802125.714160:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892092800 00000100:00100000:2.0:1788802125.714170:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892092800 00000100:00100000:2.0:1788802125.714255:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788802125.714264:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2f8180f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:5840:x1875694892092800:12345-0@lo:101: 00010000:00010000:2.0:1788802125.714279:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802125.714303:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9252773/0x6ecba1490fc9bb3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bb38 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802125.714326:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9252773/0x6ecba1490fc9bb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb38 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802125.714347:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9252773/0x6ecba1490fc9bb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb38 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802125.714355:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9252773, rc 0) 00000100:00100000:2.0:1788802125.714409:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2f8180f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5840:x1875694892092800:12345-0@lo:101: Request processed in 147us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802125.714414:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788802125.714464:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005691c9bd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892092800:0@lo:101: 00010000:00010000:2.0:1788802125.714478:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9bb38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802125.714486:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9bb38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802125.714540:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892092928:0@lo:256: 00000100:00100000:2.0:1788802125.714573:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802125.714596:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2f603ab going to sleep for 11 seconds 00000100:00100000:2.0:1788802125.714609:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892092928 00000100:00100000:2.0:1788802125.714613:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892092928 00000100:00100000:2.0:1788802125.714633:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788802125.714639:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ebec5e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5840:x1875694892092928:12345-0@lo:256: 20000000:01000000:2.0:1788802125.714652:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788802125.714685:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788802125.714693:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788802125.714774:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ebec5e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5840:x1875694892092928:12345-0@lo:256: Request processed in 135us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802125.714782:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788802125.714811:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049598c42 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892092928:0@lo:256: 10000000:01000000:2.0:1788802125.714848:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788802125.714854:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9bb38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802125.714861:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: 00000000c2da51d2/0x6ecba1490fc9bb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1788802125.883328:0:6120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788802125.900856:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802126.927283:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802127.948763:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802128.981976:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802129.298117:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802129.298142:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5941f6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892093056:0@lo:400: 00000100:00100000:1.0:1788802129.298258:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802129.298317:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892093056 00000100:00100000:1.0:1788802129.298325:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892093056 00000100:00100000:1.0:1788802129.298374:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788802129.298383:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002eefc23b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:3313:x1875694892093056:12345-0@lo:400: 00000100:00100000:1.0:1788802129.298431:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002eefc23b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:3313:x1875694892093056:12345-0@lo:400: Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802129.298438:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788802129.298484:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5941f6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892093056:0@lo:400: 00000100:00100000:2.0:1788802129.298779:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009cb9b0f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892093184:0@lo:400: 00000100:00100000:2.0:1788802129.304387:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802129.304912:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892093184 00000100:00100000:1.0:1788802129.304923:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892093184 00000100:00100000:1.0:1788802129.304973:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802129.304981:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000049598c42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892093184:12345-0@lo:400: 00000100:00100000:1.0:1788802129.305049:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000049598c42 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892093184:12345-0@lo:400: Request processed in 69us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802129.305057:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788802129.305087:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009cb9b0f7 x1875694892093184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802129.305102:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009cb9b0f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892093184:0@lo:400: 00010000:00010000:1.0:1788802129.996840:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788802130.897702:0:6321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd67a20c10 20000000:00000080:0.0:1788802130.897723:0:6321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910d3385c000 uarg=0000000000000000 20000000:01000000:0.0:1788802130.897760:0:6321:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788802130.897767:0:6321:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788802130.897771:0:6321:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788802130.900507:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788802130.900526:0:6321:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788802130.906117:0:6321:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788802130.906452:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788802130.906510:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788802130.906559:0:6321:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788802130.906576:0:6321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788802130.906595:0:6321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802130.906616:0:6321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000848bd6c0/0x6ecba1490fc9bb07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb00 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802130.906624:0:6321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802130.906691:0:6321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000848bd6c0/0x6ecba1490fc9bb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bb00 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802130.906712:0:6321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000848bd6c0/0x6ecba1490fc9bb07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb00 expref: 11 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802130.906729:0:6321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079fa98a6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1875694892093312:0@lo:104: 00000100:00100000:2.0:1788802130.906818:0:6321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802130.906881:0:6321:0:(client.c:2716:ptlrpc_set_wait()) set 0000000095222fe0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802130.907026:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892093312 00000100:00100000:3.0:1788802130.907035:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892093312 00000100:00100000:3.0:1788802130.907090:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788802130.907099:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000697bdd7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:6321:x1875694892093312:12345-0@lo:104: 00010000:00010000:3.0:1788802130.907113:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907179:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788802130.907185:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000697bdd7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:6321:x1875694892093312:12345-0@lo:104: Request processed in 88us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802130.907202:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788802130.907226:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788802130.907232:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907254:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010b1e352 already unused, calling callback (000000006ff4c7b6) 10000000:00010000:3.0:1788802130.907257:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907265:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788802130.907271:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802130.907277:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788802130.907305:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907313:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788802130.907329:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907335:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: 0000000010b1e352/0x6ecba1490fc9bb00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb07 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907351:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802130.907353:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802130.907354:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802130.907372:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c25bf7ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892093440:0@lo:103: 00000100:00100000:3.0:1788802130.907412:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802130.907453:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892093440 00000100:00100000:3.0:1788802130.907458:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892093440 00010000:00010000:3.0:1788802130.907475:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000848bd6c0/0x6ecba1490fc9bb07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb00 expref: 12 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802130.907496:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788802130.907501:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a46129f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:3312:x1875694892093440:12345-0@lo:103: 00010000:00010000:3.0:1788802130.907511:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802130.907515:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000848bd6c0/0x6ecba1490fc9bb07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb00 expref: 12 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907523:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000848bd6c0/0x6ecba1490fc9bb07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb00 expref: 12 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907538:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907544:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907556:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907561:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907567:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907572:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907583:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a76a3a78 already unused, calling callback (00000000f05f20b9) 00010000:00010000:3.0:1788802130.907586:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907592:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907600:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802130.907610:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802130.907639:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a46129f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:3312:x1875694892093440:12345-0@lo:103: Request processed in 138us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802130.907645:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788802130.907679:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c25bf7ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892093440:0@lo:103: 00010000:00010000:1.0:1788802130.907718:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000848bd6c0/0x6ecba1490fc9bb07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bb00 expref: 11 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802130.907728:0:6321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079fa98a6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6321:1875694892093312:0@lo:104: 00010000:00010000:1.0:1788802130.907740:0:6321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802130.907748:0:6321:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802130.907754:0:6321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802130.907765:0:6321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a76a3a78/0x6ecba1490fc9bb46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802131.023150:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802132.047867:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788802132.492289:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788802132.492298:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d054ea800 from 1 10000000:01000000:3.0:1788802132.492302:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788802132.492347:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: 000000007a5d2744/0x6ecba1490fc9bb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802132.492360:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: 000000007a5d2744/0x6ecba1490fc9bb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802132.492370:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: 000000007a5d2744/0x6ecba1490fc9bb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802132.492393:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c25bf7ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892093568:0@lo:101: 00000100:00100000:3.0:1788802132.492473:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802132.492535:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072157692 going to sleep for 11 seconds 00000100:00100000:1.0:1788802132.492600:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892093568 00000100:00100000:1.0:1788802132.492609:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892093568 00000100:00100000:1.0:1788802132.492659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788802132.492667:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000011aef79d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:5840:x1875694892093568:12345-0@lo:101: 00010000:00010000:1.0:1788802132.492680:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802132.492693:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009df400fe/0x6ecba1490fc9bb54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bb4d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802132.492717:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009df400fe/0x6ecba1490fc9bb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb4d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802132.492728:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009df400fe/0x6ecba1490fc9bb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb4d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802132.492738:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009df400fe, rc 0) 00000100:00100000:1.0:1788802132.492795:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000011aef79d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5840:x1875694892093568:12345-0@lo:101: Request processed in 129us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802132.492802:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788802132.492875:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c25bf7ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892093568:0@lo:101: 00010000:00010000:3.0:1788802132.492888:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: 000000007a5d2744/0x6ecba1490fc9bb4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802132.492896:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: 000000007a5d2744/0x6ecba1490fc9bb4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802132.492944:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c25bf7ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892093696:0@lo:501: 00000100:00100000:3.0:1788802132.492967:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802132.492988:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072157692 going to sleep for 11 seconds 00000100:00100000:2.0:1788802132.493041:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892093696 00000100:00100000:2.0:1788802132.493046:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892093696 00000100:00100000:2.0:1788802132.493078:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788802132.493084:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000535dc7ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5840:x1875694892093696:12345-0@lo:501: 00000100:00100000:2.0:1788802132.493373:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000535dc7ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5840:x1875694892093696:12345-0@lo:501: Request processed in 289us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802132.493380:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788802132.493461:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c25bf7ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892093696:0@lo:501: 00000100:00100000:3.0:1788802132.493489:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c25bf7ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892093824:0@lo:503: 00000100:00100000:3.0:1788802132.493527:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802132.493555:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072157692 going to sleep for 11 seconds 00000100:00100000:1.0:1788802132.493612:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892093824 00000100:00100000:1.0:1788802132.493617:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892093824 00000100:00100000:1.0:1788802132.493646:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788802132.493652:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000adbdc3a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5840:x1875694892093824:12345-0@lo:503: 00000100:00100000:1.0:1788802132.493786:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000adbdc3a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5840:x1875694892093824:12345-0@lo:503: Request processed in 134us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802132.493801:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788802132.496572:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c25bf7ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892093824:0@lo:503: 00000100:00100000:2.0:1788802132.497534:0:6382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f3eeedc pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6382:1875694892093952:0@lo:502: 00000100:00100000:2.0:1788802132.497618:0:6382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802132.497664:0:6382:0:(client.c:2716:ptlrpc_set_wait()) set 000000001fcfc5f3 going to sleep for 11 seconds 00000100:00100000:1.0:1788802132.497713:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892093952 00000100:00100000:1.0:1788802132.497721:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892093952 00000100:00100000:1.0:1788802132.497780:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788802132.497788:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e38730db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6382:x1875694892093952:12345-0@lo:502: 00000100:00100000:1.0:1788802132.497961:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e38730db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6382:x1875694892093952:12345-0@lo:502: Request processed in 173us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802132.497969:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788802132.498022:0:6382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f3eeedc pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6382:1875694892093952:0@lo:502: 00000020:01000000:1.0:1788802132.498049:0:6382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788802132.498060:0:6382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802132.498062:0:6382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788802132.498069:0:6382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d054ea800 00000020:00000080:1.0:1788802132.498071:0:6382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788802132.498112:0:6382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6382:1875694892094080:0@lo:502: 00000100:00100000:1.0:1788802132.498146:0:6382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802132.498168:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892094080 00000100:00100000:1.0:1788802132.498171:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892094080 00000100:00100000:1.0:1788802132.498192:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788802132.498198:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6382:x1875694892094080:12345-0@lo:502: 00000100:00100000:1.0:1788802132.498323:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6382:x1875694892094080:12345-0@lo:502: Request processed in 125us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802132.498344:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788802132.498372:0:6382:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08206180 going to sleep for 11 seconds 00000100:00100000:1.0:1788802132.498384:0:6382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6382:1875694892094080:0@lo:502: 00000020:01000000:1.0:1788802132.498401:0:6382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788802132.498409:0:6382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802132.498411:0:6382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788802132.498414:0:6382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788802132.498474:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788802132.498493:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788802132.498503:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216f800/0x6ecba1490fc9bb4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802132.498518:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d4216f800/0x6ecba1490fc9bb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802133.072306:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802134.101816:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802134.414803:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892094208:0@lo:400: 00000100:00100000:1.0:1788802134.414883:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802134.420502:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892094208 00000100:00100000:2.0:1788802134.420516:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892094208 00000100:00100000:2.0:1788802134.420568:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788802134.420580:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:3313:x1875694892094208:12345-0@lo:400: 00000100:00100000:0.0:1788802134.427791:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892094336:0@lo:400: 00000100:00100000:0.0:1788802134.427876:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802134.427966:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892094336 00000100:00100000:0.0:1788802134.427975:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892094336 00000100:00100000:0.0:1788802134.428024:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788802134.428032:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892094336:12345-0@lo:400: 00000100:00100000:0.0:1788802134.428088:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892094336:12345-0@lo:400: Request processed in 57us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802134.428095:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788802134.428133:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910d10d3fb80 x1875694892094336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802134.428157:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892094336:0@lo:400: 00000100:00100000:2.0:1788802134.437309:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:3313:x1875694892094208:12345-0@lo:400: Request processed in 16720us (22413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802134.437355:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892094208:0@lo:400: 00000100:00100000:2.0:1788802134.437397:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1788802135.116534:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802136.140450:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802137.173608:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788802137.891300:0:6685:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788802137.891306:0:6685:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788802137.891464:0:6685:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff910d1d17c800 00000020:01000004:2.0:1788802137.891495:0:6685:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788802137.891510:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788802137.891530:0:6685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff910d10d599c0) 00000020:00000080:2.0:1788802137.891548:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788802137.923310:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788802137.924051:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788802137.962673:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788802137.982601:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788802137.982646:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788802137.986134:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788802137.986175:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788802137.986976:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788802137.986993:0:6685:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788802137.987008:0:6685:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6ecba1490fc9bb62 00000020:01000004:3.0:1788802137.987020:0:6685:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788802137.987048:0:6685:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.157@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788802137.987053:0:6685:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788802137.987067:0:6685:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788802137.987073:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788802137.987089:0:6685:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff910d347ccd40) 00000020:00000080:3.0:1788802137.987108:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788802137.989940:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802137.995927:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788802137.995939:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788802137.998472:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788802137.998489:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788802138.015147:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788802138.015568:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788802138.019871:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802138.020172:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788802138.020180:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788802138.029798:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788802138.029828:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788802138.100502:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802138.100834:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788802138.100839:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788802138.103103:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788802138.103119:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788802138.105766:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788802138.105787:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788802138.111747:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788802138.111955:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788802138.111962:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788802138.112876:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788802138.112885:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1788802138.201404:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802138.243197:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788802138.243871:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788802138.243878:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788802138.254543:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788802138.254556:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788802138.255076:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788802138.255100:0:6685:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788802138.255107:0:6685:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788802138.294229:0:6685:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788802138.294300:0:6685:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.157@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788802138.294305:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788802138.294306:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788802138.294323:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788802138.294325:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788802138.294326:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788802138.294327:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788802138.294328:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788802138.294330:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788802138.294331:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788802138.294333:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788802138.294335:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788802138.294338:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788802138.294345:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788802138.294347:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788802138.294348:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788802138.294349:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788802138.294350:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788802138.294351:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788802138.294352:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788802138.294353:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788802138.294354:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788802138.294355:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788802138.294355:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788802138.294381:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788802138.294400:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3383a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892094464:0@lo:253: 00000100:00100000:3.0:1788802138.294664:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802138.294719:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d41b92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802138.294834:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892094464 00000100:00100000:2.0:1788802138.294842:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892094464 00000100:00100000:2.0:1788802138.294901:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788802138.294911:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892094464:12345-0@lo:253: 20000000:01000000:2.0:1788802138.294943:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788802138.294947:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788802138.294952:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788802138.294956:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788802138.299778:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788802138.300090:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788802138.300116:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788802138.300159:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788802138.300167:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788802138.300196:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788802138.300800:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788802138.301895:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788802138.301924:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.157@tcp 20000000:01000000:2.0:1788802138.301927:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.157@tcp (null) (null) (null) 00000040:00080000:2.0:1788802138.301968:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788802138.301977:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788802138.302108:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788802138.302117:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.157@tcp (null) (null) 00000040:00080000:2.0:1788802138.302149:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788802138.302158:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788802138.302186:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788802138.302232:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788802138.304781:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788802138.304817:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.157@tcp 20000000:01000000:2.0:1788802138.304821:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.157@tcp (null) (null) (null) 00000040:00080000:2.0:1788802138.304862:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788802138.304871:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788802138.304904:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788802138.304912:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.157@tcp (null) (null) 00000040:00080000:2.0:1788802138.304958:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788802138.304969:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788802138.305125:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788802138.305165:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788802138.305189:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788802138.305192:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788802138.305196:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788802138.305211:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788802138.305224:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788802138.305292:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788802138.305295:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788802138.306355:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788802138.306830:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788802138.306877:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788802138.306955:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788802138.306970:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788802138.306972:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788802138.307800:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788802138.307860:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788802138.307916:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788802138.309192:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788802138.309319:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788802138.309416:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788802138.309436:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788802138.309438:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788802138.310863:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1788802138.310938:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1788802138.311012:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788802138.311416:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788802138.311470:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788802138.311501:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788802138.311516:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788802138.311518:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788802138.311527:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788802138.311551:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.311569:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9ba89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ba82 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.311690:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9baa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ba9e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.311698:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bb15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb0e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.311706:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.311751:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bb0e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.311767:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bb15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb0e expref: 12 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802138.311785:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875694892094592:0@lo:104: 00000100:00100000:0.0:1788802138.311869:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788802138.311935:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9baa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9ba9e expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.311944:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9baa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9ba9e expref: 12 pid: 5834 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802138.311953:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875694892094720:0@lo:104: 00000100:00100000:0.0:1788802138.311970:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788802138.312035:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9ba89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9ba82 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.312044:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9ba89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9ba82 expref: 12 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802138.312052:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875694892094848:0@lo:104: 00000100:00100000:0.0:1788802138.312068:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802138.313149:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243000 going to sleep for 11 seconds 00000100:00100000:1.0:1788802138.313273:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892094592 00000100:00100000:1.0:1788802138.313283:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892094592 00000100:00100000:1.0:1788802138.313323:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892094720 00000100:00100000:1.0:1788802138.313340:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892094720 00000100:00100000:1.0:1788802138.313354:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892094848 00000100:00100000:1.0:1788802138.313357:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892094848 00000100:00100000:1.0:1788802138.313372:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788802138.313381:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:5836:x1875694892094592:12345-0@lo:104: 00010000:00010000:1.0:1788802138.313397:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.313551:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788802138.313558:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:5836:x1875694892094592:12345-0@lo:104: Request processed in 178us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802138.313565:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788802138.313697:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875694892094592:0@lo:104: 00000100:00100000:1.0:1788802138.313742:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788802138.313751:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:5836:x1875694892094720:12345-0@lo:104: 00010000:00010000:1.0:1788802138.313760:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9ba9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.313811:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788802138.313817:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:5836:x1875694892094720:12345-0@lo:104: Request processed in 68us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802138.313824:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788802138.313836:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788802138.313842:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5836:x1875694892094848:12345-0@lo:104: 00010000:00010000:1.0:1788802138.313850:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d4216ee00/0x6ecba1490fc9ba82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.313877:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788802138.313882:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5836:x1875694892094848:12345-0@lo:104: Request processed in 41us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802138.313895:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788802138.313914:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788802138.313920:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.313928:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d6000 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802138.313933:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.313943:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bb0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802138.313951:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bb0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802138.313958:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788802138.314093:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788802138.314309:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875694892094720:0@lo:104: 00000100:00100000:0.0:1788802138.314318:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875694892094848:0@lo:104: 00010000:00010000:0.0:1788802138.314342:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.314709:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bb0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.314717:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802138.314737:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bb0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.314744:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bb0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb15 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.314759:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802138.314763:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d4216ee00/0x6ecba1490fc9ba82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.314780:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216ee00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802138.314784:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d4216ee00/0x6ecba1490fc9ba82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.314791:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d4216ee00/0x6ecba1490fc9ba82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802138.314799:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d4216ee00/0x6ecba1490fc9ba82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802138.314804:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788802138.314820:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d4216ee00/0x6ecba1490fc9ba82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.314826:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802138.314830:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d4216ee00/0x6ecba1490fc9ba82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.314837:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d4216ee00/0x6ecba1490fc9ba82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ba89 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.314847:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802138.314849:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802138.314851:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802138.314864:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892095104:0@lo:103: 00000100:00100000:1.0:1788802138.314903:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802138.314937:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788802138.314942:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892094976:0@lo:103: 00000100:00100000:1.0:1788802138.314973:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802138.315088:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892095104 00000100:00100000:1.0:1788802138.315095:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892095104 00010000:00010000:1.0:1788802138.315119:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9ba89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ba82 expref: 13 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802138.315143:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892094976 00000100:00100000:1.0:1788802138.315146:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892094976 00010000:00010000:1.0:1788802138.315157:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bb15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb0e expref: 14 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802138.315169:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788802138.315175:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:3312:x1875694892095104:12345-0@lo:103: 00010000:00010000:1.0:1788802138.315187:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802138.315192:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9ba89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ba82 expref: 14 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.315201:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9ba89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9ba82 expref: 14 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.315217:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9ba89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9ba82 expref: 14 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.315229:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802138.315278:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:3312:x1875694892095104:12345-0@lo:103: Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802138.315285:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788802138.315300:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788802138.315305:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:3312:x1875694892094976:12345-0@lo:103: 00010000:00010000:1.0:1788802138.315312:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802138.315322:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bb15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb0e expref: 12 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.315332:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb0e expref: 12 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.315342:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bb15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bb0e expref: 12 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.315351:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802138.315374:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:3312:x1875694892094976:12345-0@lo:103: Request processed in 69us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802138.315380:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788802138.315413:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892094976:0@lo:103: 00000100:00100000:1.0:1788802138.315422:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892095104:0@lo:103: 00010000:00010000:3.0:1788802138.315842:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802138.315846:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802138.315848:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802138.315916:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9ba9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.315926:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216ea00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802138.315930:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9ba9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.315946:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9ba9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802138.315953:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9ba9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802138.315960:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788802138.316093:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9ba9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.316101:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788802138.316140:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892095232:0@lo:103: 00000100:00100000:1.0:1788802138.316170:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802138.316233:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892095232 00000100:00100000:3.0:1788802138.316258:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892095232 00010000:00010000:3.0:1788802138.316277:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9baa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ba9e expref: 11 pid: 5834 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802138.316300:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788802138.316307:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:3313:x1875694892095232:12345-0@lo:103: 00010000:00010000:3.0:1788802138.316315:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802138.316320:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9baa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ba9e expref: 11 pid: 5834 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316331:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9baa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9ba9e expref: 11 pid: 5834 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316342:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9baa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9ba9e expref: 11 pid: 5834 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316362:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316371:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316387:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316395:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316401:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316408:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316414:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802138.316419:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316426:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316440:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.316459:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788802138.316668:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9ba9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.316677:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9ba9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9baa5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.316695:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802138.316697:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802138.316699:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802138.316714:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.316723:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.316729:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f1200/0x6ecba1490fc9bb70 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788802138.316743:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788802138.316891:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:3313:x1875694892095232:12345-0@lo:103: Request processed in 582us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802138.316907:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788802138.316962:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892095232:0@lo:103: 00000100:00100000:0.0:1788802138.452100:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:6685:x1875694892094464:12345-0@lo:253: Request processed in 157181us (157425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802138.452115:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788802138.452126:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3383a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892094464:0@lo:253: 10000000:01000000:2.0:1788802138.452141:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788802138.452144:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788802138.452146:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788802138.452148:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788802138.452149:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788802138.452150:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788802138.452152:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788802138.452153:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788802138.452155:0:6685:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788802138.452156:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788802138.452158:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788802138.452178:0:6685:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910d1d17c800 from lustre-OST0000 10000000:01000000:2.0:1788802138.452203:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788802138.452206:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788802138.452212:0:6685:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff910d10cbcd40 local copy 10000000:01000000:2.0:1788802138.452216:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788802138.452283:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802138.452294:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802138.452318:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802138.452338:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892095360:0@lo:101: 00000100:00100000:0.0:1788802138.452409:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802138.452436:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892095360 00000100:00100000:2.0:1788802138.452443:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892095360 00000100:00100000:0.0:1788802138.452457:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d119feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802138.452478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788802138.452487:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:6685:x1875694892095360:12345-0@lo:101: 00010000:00010000:2.0:1788802138.452500:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802138.452514:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d029d6000/0x6ecba1490fc9bb7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bb77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802138.452538:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d029d6000/0x6ecba1490fc9bb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb77 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802138.452550:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d029d6000/0x6ecba1490fc9bb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb77 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802138.452559:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d029d6000, rc 0) 00000100:00100000:2.0:1788802138.452812:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:6685:x1875694892095360:12345-0@lo:101: Request processed in 326us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802138.452819:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788802138.452871:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892095360:0@lo:101: 00010000:00010000:0.0:1788802138.452884:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.452893:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802138.452968:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892095488:0@lo:501: 00000100:00100000:0.0:1788802138.452985:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802138.453030:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243180 going to sleep for 11 seconds 00000100:00100000:2.0:1788802138.453057:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892095488 00000100:00100000:2.0:1788802138.453061:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892095488 00000100:00100000:2.0:1788802138.453106:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788802138.453111:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:6685:x1875694892095488:12345-0@lo:501: 00000100:00100000:2.0:1788802138.453291:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:6685:x1875694892095488:12345-0@lo:501: Request processed in 179us (304us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788802138.453301:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788802138.453344:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892095488:0@lo:501: 10000000:01000000:0.0:1788802138.453353:0:6685:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788802138.453369:0:6685:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788802138.453372:0:6685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.453378:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.453382:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.453400:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788802138.453419:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910d1d17c800 10000000:01000000:0.0:1788802138.453423:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788802138.453426:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff910d10cbcd40 10000000:01000000:0.0:1788802138.453428:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788802138.453430:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff910d10cbcd40 from 1 10000000:01000000:0.0:1788802138.453432:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788802138.453444:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1200/0x6ecba1490fc9bb85 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.453449:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f1200/0x6ecba1490fc9bb85 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.453455:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f1200/0x6ecba1490fc9bb85 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802138.453461:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892095616:0@lo:101: 00000100:00100000:0.0:1788802138.453477:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788802138.453509:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788802138.453515:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.453520:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d6400 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:3.0:1788802138.453522:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.453528:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788802138.453533:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802138.453536:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788802138.453550:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.453554:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788802138.453567:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.453582:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bb77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6ecba1490fc9bb7e expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.453597:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802138.453598:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802138.453600:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802138.453611:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892095744:0@lo:103: 00000100:00100000:3.0:1788802138.453638:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802138.453826:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892095744 00000100:00100000:3.0:1788802138.453831:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892095744 00000100:00100000:3.0:1788802138.453870:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788802138.453880:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:3314:x1875694892095744:12345-0@lo:103: 00010000:00010000:3.0:1788802138.453890:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802138.453904:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d029d6000/0x6ecba1490fc9bb7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bb77 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.453918:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802138.453947:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:3314:x1875694892095744:12345-0@lo:103: Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802138.453953:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788802138.453989:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892095744:0@lo:103: 00000100:00100000:0.0:1788802138.454155:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243540 going to sleep for 11 seconds 00000100:00100000:1.0:1788802138.457007:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892095616 00000100:00100000:1.0:1788802138.457022:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892095616 00000100:00100000:0.0:1788802138.457159:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788802138.457169:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:6685:x1875694892095616:12345-0@lo:101: 00010000:00010000:0.0:1788802138.457194:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802138.457214:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f1800/0x6ecba1490fc9bb8c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bb85 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.457272:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f1800/0x6ecba1490fc9bb8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb85 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.457283:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f1800/0x6ecba1490fc9bb8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb85 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.457309:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1800, rc 0) 00000100:00100000:0.0:1788802138.457374:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:6685:x1875694892095616:12345-0@lo:101: Request processed in 207us (3895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802138.457378:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788802138.457463:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892095616:0@lo:101: 00010000:00010000:1.0:1788802138.457476:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f1200/0x6ecba1490fc9bb85 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb8c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.457484:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f1200/0x6ecba1490fc9bb85 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bb8c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802138.457498:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788802138.457514:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1200/0x6ecba1490fc9bb85 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb8c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.457522:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f1200/0x6ecba1490fc9bb85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb8c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802138.457532:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788802138.457536:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788802138.457543:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788802138.457546:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788802138.457572:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.457591:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.457601:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802138.457621:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892095872:0@lo:101: 00000100:00100000:1.0:1788802138.457666:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802138.457820:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08a653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802138.457870:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892095872 00000100:00100000:0.0:1788802138.457875:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892095872 00000100:00100000:0.0:1788802138.457907:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788802138.457914:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+10:6685:x1875694892095872:12345-0@lo:101: 00010000:00010000:0.0:1788802138.457921:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802138.457931:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bb9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bb93 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.457945:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb93 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.457954:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb93 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.457960:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0c00, rc 0) 00000100:00100000:0.0:1788802138.457987:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:6685:x1875694892095872:12345-0@lo:101: Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802138.457992:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788802138.458073:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892095872:0@lo:101: 00010000:00010000:1.0:1788802138.458083:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.458091:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802138.458192:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096000:0@lo:501: 00000100:00100000:1.0:1788802138.458224:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802138.458262:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08a653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802138.458277:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892096000 00000100:00100000:1.0:1788802138.458281:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892096000 00000100:00100000:1.0:1788802138.458300:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788802138.458306:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:6685:x1875694892096000:12345-0@lo:501: 00000100:00100000:1.0:1788802138.458545:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:6685:x1875694892096000:12345-0@lo:501: Request processed in 239us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802138.458552:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788802138.458660:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096000:0@lo:501: 00000100:00100000:1.0:1788802138.458894:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096128:0@lo:503: 00000100:00100000:1.0:1788802138.458931:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802138.459022:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08a653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802138.459118:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892096128 00000100:00100000:3.0:1788802138.459122:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892096128 00000100:00100000:3.0:1788802138.459140:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788802138.459144:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:6685:x1875694892096128:12345-0@lo:503: 00000100:00100000:3.0:1788802138.459288:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:6685:x1875694892096128:12345-0@lo:503: Request processed in 142us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802138.459295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788802138.459305:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096128:0@lo:503: 00000040:00080000:2.0:1788802138.459549:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788802138.459690:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096256:0@lo:502: 00000100:00100000:2.0:1788802138.459726:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802138.459754:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d119feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802138.459885:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892096256 00000100:00100000:3.0:1788802138.459889:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892096256 00000100:00100000:3.0:1788802138.459939:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788802138.459945:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:6685:x1875694892096256:12345-0@lo:502: 00000100:00100000:3.0:1788802138.460044:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:6685:x1875694892096256:12345-0@lo:502: Request processed in 99us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802138.460059:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788802138.460076:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096256:0@lo:502: 00000040:00080000:2.0:1788802138.460351:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788802138.460400:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788802138.460435:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788802138.460475:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788802138.460496:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788802138.460511:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788802138.460528:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096384:0@lo:502: 00000100:00100000:2.0:1788802138.460554:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802138.460686:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d119feb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788802138.460694:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892096384 00000100:00100000:0.0:1788802138.460699:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892096384 00000100:00100000:0.0:1788802138.460757:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788802138.460763:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:6685:x1875694892096384:12345-0@lo:502: 00000100:00100000:0.0:1788802138.460862:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:6685:x1875694892096384:12345-0@lo:502: Request processed in 99us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802138.460874:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788802138.460892:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096384:0@lo:502: 00000040:00080000:2.0:1788802138.460960:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788802138.460969:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788802138.461330:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788802138.461338:0:6704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788802138.461346:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802138.461348:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788802138.461353:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788802138.461367:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff910d10d58000) 00000020:00000080:2.0:1788802138.461389:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788802138.461394:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788802138.461468:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d1d17c800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788802138.461473:0:6704:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788802138.461478:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6ecba1490fc9bba8 00010000:00010000:0.0:1788802138.466933:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788802138.467984:0:6704:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788802138.470408:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788802138.470861:0:6704:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788802138.477141:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788802138.477835:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788802138.479211:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788802138.479221:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802138.479226:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802138.479228:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788802138.479230:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788802138.479233:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802138.479234:0:6704:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788802138.479235:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788802138.479263:0:6704:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788802138.479302:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802138.479303:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802138.479304:0:6704:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788802138.479307:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788802138.479414:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788802138.479435:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788802138.479453:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802138.479463:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802138.479469:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d1d17c800 from 1 10000000:01000000:2.0:1788802138.479470:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788802138.479501:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802138.479506:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802138.479514:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802138.479532:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096512:0@lo:101: 00000100:00100000:2.0:1788802138.479609:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802138.479668:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892096512 00000100:00100000:3.0:1788802138.479677:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892096512 00000100:00100000:3.0:1788802138.479720:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788802138.479730:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:6685:x1875694892096512:12345-0@lo:101: 00010000:00010000:3.0:1788802138.479743:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788802138.479747:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d119fecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788802138.479754:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9bbb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bbaf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.479777:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9bbb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbaf expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.479789:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9bbb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbaf expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.479797:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216ec00, rc 0) 00000100:00100000:3.0:1788802138.479948:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892096512:12345-0@lo:101: Request processed in 219us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802138.479955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788802138.480024:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096512:0@lo:101: 00010000:00010000:2.0:1788802138.480039:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802138.480048:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802138.480153:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096640:0@lo:501: 00000100:00100000:2.0:1788802138.480177:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802138.480257:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d119fecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802138.480349:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892096640 00000100:00100000:0.0:1788802138.480354:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892096640 00000100:00100000:0.0:1788802138.480415:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788802138.480423:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892096640:12345-0@lo:501: 00000100:00100000:0.0:1788802138.481475:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892096640:12345-0@lo:501: Request processed in 1049us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802138.481483:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788802138.481728:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096640:0@lo:501: 00000100:00100000:2.0:1788802138.481771:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096768:0@lo:503: 00000100:00100000:2.0:1788802138.481809:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802138.481840:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d119fecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802138.481866:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892096768 00000100:00100000:3.0:1788802138.481874:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892096768 00000100:00100000:3.0:1788802138.481905:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788802138.481913:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892096768:12345-0@lo:503: 00000100:00100000:3.0:1788802138.482167:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892096768:12345-0@lo:503: Request processed in 254us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802138.482174:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788802138.482178:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096768:0@lo:503: 00000040:00080000:2.0:1788802138.482476:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788802138.482549:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096896:0@lo:502: 00000100:00100000:2.0:1788802138.482756:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802138.482775:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72540 going to sleep for 11 seconds 00000100:00100000:3.0:1788802138.482799:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892096896 00000100:00100000:3.0:1788802138.482806:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892096896 00000100:00100000:1.0:1788802138.482921:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788802138.482932:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892096896:12345-0@lo:502: 00000100:00100000:1.0:1788802138.483092:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892096896:12345-0@lo:502: Request processed in 162us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802138.483099:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788802138.483134:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892096896:0@lo:502: 00000040:00080000:3.0:1788802138.483506:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788802138.483576:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788802138.483604:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097024:0@lo:502: 00000100:00100000:3.0:1788802138.483644:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802138.483736:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d41b929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802138.483817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892097024 00000100:00100000:0.0:1788802138.483823:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892097024 00000100:00100000:0.0:1788802138.483968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788802138.483977:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892097024:12345-0@lo:502: 00000100:00100000:0.0:1788802138.484143:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892097024:12345-0@lo:502: Request processed in 167us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802138.484151:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788802138.484233:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097024:0@lo:502: 00000040:00080000:1.0:1788802138.484365:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788802138.484377:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788802138.485018:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788802138.485029:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802138.485031:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788802138.485038:0:6708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d1d17c800 00000020:00000080:1.0:1788802138.485047:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788802138.485075:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788802138.485078:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802138.485079:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788802138.485083:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788802138.485117:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788802138.485135:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788802138.485151:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.485164:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802138.485205:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788802138.485209:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910d1d17c800 10000000:01000000:1.0:1788802138.485212:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910d1d17c800 10000000:01000000:1.0:1788802138.485217:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788802138.485223:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d1d17c800 from 1 10000000:01000000:1.0:1788802138.485226:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788802138.485280:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.485290:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.485302:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802138.485323:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097152:0@lo:101: 00000100:00100000:1.0:1788802138.485372:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802138.485590:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08a65600 going to sleep for 11 seconds 00000100:00100000:3.0:1788802138.485632:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892097152 00000100:00100000:3.0:1788802138.485639:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892097152 00000100:00100000:3.0:1788802138.485684:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788802138.485692:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892097152:12345-0@lo:101: 00010000:00010000:3.0:1788802138.485704:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802138.485719:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bbc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bbbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.485743:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbbd expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.485754:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbbd expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.485765:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216e000, rc 0) 00000100:00100000:3.0:1788802138.485815:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6685:x1875694892097152:12345-0@lo:101: Request processed in 122us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802138.485822:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788802138.486036:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097152:0@lo:101: 00010000:00010000:1.0:1788802138.486050:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.486059:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802138.486145:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097280:0@lo:501: 00000100:00100000:1.0:1788802138.486176:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802138.486271:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08a65600 going to sleep for 11 seconds 00000100:00100000:3.0:1788802138.486356:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892097280 00000100:00100000:3.0:1788802138.486361:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892097280 00000100:00100000:3.0:1788802138.486388:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788802138.486393:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6685:x1875694892097280:12345-0@lo:501: 00000100:00100000:3.0:1788802138.486824:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6685:x1875694892097280:12345-0@lo:501: Request processed in 429us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802138.486905:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788802138.487000:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097280:0@lo:501: 00000100:00100000:2.0:1788802138.487030:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097408:0@lo:503: 00000100:00100000:2.0:1788802138.487067:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802138.487187:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72000 going to sleep for 11 seconds 00000100:00100000:3.0:1788802138.487631:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892097408 00000100:00100000:3.0:1788802138.487636:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892097408 00000100:00100000:3.0:1788802138.487677:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788802138.487685:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6685:x1875694892097408:12345-0@lo:503: 00000100:00100000:2.0:1788802138.487936:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097408:0@lo:503: 00000100:00100000:3.0:1788802138.487937:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6685:x1875694892097408:12345-0@lo:503: Request processed in 252us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802138.487948:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000040:00080000:2.0:1788802138.488150:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788802138.488195:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097536:0@lo:502: 00000100:00100000:2.0:1788802138.488222:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802138.488264:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72000 going to sleep for 11 seconds 00000100:00100000:3.0:1788802138.488320:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892097536 00000100:00100000:3.0:1788802138.488326:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892097536 00000100:00100000:3.0:1788802138.488352:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788802138.488360:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6685:x1875694892097536:12345-0@lo:502: 00000100:00100000:3.0:1788802138.488600:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6685:x1875694892097536:12345-0@lo:502: Request processed in 241us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802138.488606:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788802138.488698:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097536:0@lo:502: 00000040:00080000:2.0:1788802138.489007:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788802138.489060:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788802138.489092:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788802138.489133:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788802138.489164:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788802138.489205:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788802138.489376:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788802138.489417:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788802138.489468:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788802138.489503:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788802138.489538:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788802138.489601:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788802138.489637:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788802138.489684:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788802138.489742:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788802138.489778:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788802138.489808:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788802138.489973:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788802138.490013:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788802138.490049:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788802138.490099:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788802138.490135:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788802138.490167:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788802138.490211:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788802138.490806:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788802138.490928:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788802138.490987:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788802138.491045:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788802138.491090:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097664:0@lo:502: 00000100:00100000:2.0:1788802138.491158:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802138.491282:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72000 going to sleep for 11 seconds 00000100:00100000:3.0:1788802138.491390:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892097664 00000100:00100000:3.0:1788802138.491397:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892097664 00000100:00100000:3.0:1788802138.491449:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788802138.491460:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6685:x1875694892097664:12345-0@lo:502: 00000100:00100000:2.0:1788802138.491849:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892097664:0@lo:502: 00000040:00080000:2.0:1788802138.491913:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000100:00100000:3.0:1788802138.491918:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6685:x1875694892097664:12345-0@lo:502: Request processed in 459us (758us total) trans 0 rc 0/0 00000040:00080000:2.0:1788802138.491928:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000100:00100000:3.0:1788802138.491930:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000020:01000004:2.0:1788802138.492318:0:6709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788802138.492332:0:6709:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff910d10d5b380) 00000020:00000080:2.0:1788802138.492349:0:6709:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788802138.492409:0:6709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d1d17c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788802138.492411:0:6709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910d1d17c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788802138.492413:0:6709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d1d17c800 3 00010000:00080000:2.0:1788802138.492434:0:6709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff910d3efbc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788802138.493841:0:6709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788802138.493990:0:6709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788802138.494015:0:6709:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788802138.494025:0:6709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6ecba1490fc9bbd2 00000100:00080000:2.0:1788802138.494033:0:6709:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788802138.494040:0:6709:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff910d3efbc800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788802138.494071:0:6709:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d3a18ca80 x1875694892097792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788802138.494095:0:6709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788802138.494139:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875694892097792:0@lo:38: 00000100:00100000:1.0:1788802138.494212:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802138.494335:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892097792 00000100:00100000:1.0:1788802138.494342:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892097792 00000100:00100000:1.0:1788802138.494374:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788802138.494381:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875694892097792:12345-0@lo:38: 00010000:00080000:1.0:1788802138.494405:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:1.0:1788802138.494433:0:5843:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6ecba1490fc9bbd9 00000004:00100000:1.0:1788802138.494448:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788802138.494481:0:5843:0:(import.c:65:import_set_state_nolock()) ffff910d33f90000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802138.494499:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892097920:0@lo:400: 00000100:00100000:1.0:1788802138.494530:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875694892097792:12345-0@lo:38: Request processed in 146us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802138.494538:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788802138.494544:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802138.494563:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892097920 00000100:00100000:1.0:1788802138.494574:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892097920 00000100:00100000:1.0:1788802138.494603:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788802138.494609:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892097920:12345-0@lo:400: 00000100:00100000:1.0:1788802138.494667:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892097920:12345-0@lo:400: Request processed in 58us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802138.494673:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788802138.494712:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910d3a18ca80 x1875694892097792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788802148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802138.494722:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788802138.494729:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788802138.494736:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788802138.494740:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788802138.494742:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3efbc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788802138.494748:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875694892097792:0@lo:38: 00000040:00080000:2.0:1788802138.494927:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:3.0:1788802138.494971:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910d33839f80 x1875694892097920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802138.494994:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892097920:0@lo:400: 00000020:01000000:1.0:1788802138.495056:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788802138.495082:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788802138.495103:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.495117:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788802138.495160:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788802138.495162:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788802138.495164:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802138.495165:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802138.495166:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802138.495168:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802138.495169:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788802138.495171:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788802138.495173:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788802138.495174:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802138.495175:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788802138.495183:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788802138.495185:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788802138.495186:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788802138.495188:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802138.495189:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802138.495190:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802138.495191:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802138.495192:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788802138.495193:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788802138.495194:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788802138.495195:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802138.495197:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788802138.495223:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788802138.495234:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892098048:0@lo:253: 00000100:00100000:1.0:1788802138.495298:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802138.495329:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802138.495469:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892098048 00000100:00100000:3.0:1788802138.495475:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892098048 00000100:00100000:3.0:1788802138.495510:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788802138.495519:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6685:x1875694892098048:12345-0@lo:253: 20000000:01000000:3.0:1788802138.495540:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788802138.495555:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788802138.524727:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788802138.524778:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788802138.524800:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788802138.524805:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788802138.524825:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.524843:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bb3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb38 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.524849:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.524885:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bb38 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.524897:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb38 expref: 13 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802138.524908:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875694892098176:0@lo:104: 00000100:00100000:0.0:1788802138.524960:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802138.525007:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d21444900 going to sleep for 11 seconds 00000100:00100000:1.0:1788802138.525011:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892098176 00000100:00100000:1.0:1788802138.525019:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892098176 00000100:00100000:1.0:1788802138.525069:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788802138.525081:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5858:x1875694892098176:12345-0@lo:104: 00010000:00010000:1.0:1788802138.525095:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9bb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.525149:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788802138.525156:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5858:x1875694892098176:12345-0@lo:104: Request processed in 78us (194us total) trans 0 rc 0/0 00010000:00010000:3.0:1788802138.525158:0:6703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788802138.525167:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788802138.525168:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9bb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802138.525178:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875694892098176:0@lo:104: 00010000:00010000:3.0:1788802138.525180:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216fa00 already unused, calling callback (ffffffffc1d69c20) 00010000:00010000:0.0:1788802138.525198:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788802138.525411:0:6703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9bb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.525425:0:6703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9bb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788802138.525433:0:6703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9bb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802138.525439:0:6703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788802138.525472:0:6703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9bb38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.525479:0:6703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788802138.525501:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9bb38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802138.525521:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892098304:0@lo:103: 00010000:00010000:3.0:1788802138.525525:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9bb38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb3f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802138.525546:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802138.525550:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802138.525552:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802138.525557:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802138.525605:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892098304 00000100:00100000:0.0:1788802138.525611:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892098304 00010000:00010000:0.0:1788802138.525628:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb38 expref: 14 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802138.525671:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788802138.525679:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:3312:x1875694892098304:12345-0@lo:103: 00010000:00010000:0.0:1788802138.525690:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802138.525696:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb38 expref: 14 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525707:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb38 expref: 14 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525718:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bb3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bb38 expref: 14 pid: 5837 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525728:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525733:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788802138.525743:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015510613s 00010000:00010000:0.0:1788802138.525746:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525751:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525755:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525759:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525768:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802138.525772:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525777:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525791:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802138.525800:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802138.525814:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802138.525822:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802138.525833:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:3312:x1875694892098304:12345-0@lo:103: Request processed in 156us (278us total) trans 0 rc 0/0 00010000:00010000:1.0:1788802138.525835:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f0a00/0x6ecba1490fc9bbe0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802138.525840:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788802138.525861:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892098304:0@lo:103: 00000100:00100000:2.0:1788802138.532969:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:6685:x1875694892098048:12345-0@lo:253: Request processed in 37439us (37658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802138.532984:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:6685:1875694892098048:0@lo:253: 00000100:00100000:2.0:1788802138.532989:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 10000000:01000000:1.0:1788802138.533001:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788802138.533005:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788802138.533006:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788802138.533007:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802138.533008:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802138.533009:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802138.533010:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802138.533011:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788802138.533012:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788802138.533013:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788802138.533014:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802138.533015:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788802138.533027:0:6685:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788802138.539618:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802138.539789:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788802138.539949:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802138.540073:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788802138.541119:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788802138.541556:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788802138.543196:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788802138.660219:0:6685:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788802138.660225:0:6685:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788802138.660316:0:6685:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788802138.660371:0:6685:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788802138.660387:0:6685:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788802138.660413:0:6685:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788802139.218271:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802140.245266:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802141.260344:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788802141.324486:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788802141.324494:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d054ea800 from 21 10000000:01000000:0.0:1788802141.324502:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788802141.324553:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802141.324565:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802141.324575:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802141.324624:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892098432:0@lo:101: 00000100:00100000:0.0:1788802141.324693:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802141.324748:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11a9ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788802141.324803:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892098432 00000100:00100000:1.0:1788802141.324811:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892098432 00000100:00100000:1.0:1788802141.324864:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788802141.324874:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5840:x1875694892098432:12345-0@lo:101: 00010000:00010000:1.0:1788802141.324887:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802141.324898:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01681400/0x6ecba1490fc9bbee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bbe7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.324933:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01681400/0x6ecba1490fc9bbee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbe7 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.324944:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01681400/0x6ecba1490fc9bbee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbe7 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.324954:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01681400, rc 0) 00000100:00100000:1.0:1788802141.325003:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892098432:12345-0@lo:101: Request processed in 130us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802141.325010:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788802141.325109:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892098432:0@lo:101: 00010000:00010000:0.0:1788802141.325124:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802141.325132:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802141.325186:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892098560:0@lo:501: 00000100:00100000:0.0:1788802141.325211:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802141.325234:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11a9ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788802141.325318:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892098560 00000100:00100000:2.0:1788802141.325323:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892098560 00000100:00100000:2.0:1788802141.325357:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788802141.325364:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892098560:12345-0@lo:501: 00000100:00100000:2.0:1788802141.325714:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892098560:12345-0@lo:501: Request processed in 350us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.325721:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788802141.326575:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892098560:0@lo:501: 00000100:00100000:0.0:1788802141.326630:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892098688:0@lo:503: 00000100:00100000:0.0:1788802141.326683:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802141.326719:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11a9ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788802141.326764:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892098688 00000100:00100000:2.0:1788802141.326769:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892098688 00000100:00100000:2.0:1788802141.326811:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788802141.326819:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892098688:12345-0@lo:503: 00000100:00100000:2.0:1788802141.327140:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892098688:12345-0@lo:503: Request processed in 321us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.327147:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788802141.327230:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892098688:0@lo:503: 00000100:00100000:2.0:1788802141.328538:0:6856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6856:1875694892098816:0@lo:502: 00000100:00100000:2.0:1788802141.328610:0:6856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802141.328648:0:6856:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d112436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802141.328694:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892098816 00000100:00100000:1.0:1788802141.328700:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892098816 00000100:00100000:1.0:1788802141.328739:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788802141.328746:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6856:x1875694892098816:12345-0@lo:502: 00000100:00100000:1.0:1788802141.329007:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6856:x1875694892098816:12345-0@lo:502: Request processed in 260us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802141.329014:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788802141.329137:0:6856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6856:1875694892098816:0@lo:502: 00000100:00100000:0.0:1788802141.329185:0:6856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6856:1875694892098944:0@lo:502: 00000100:00100000:0.0:1788802141.329218:0:6856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802141.329268:0:6856:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11a9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788802141.329524:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892098944 00000100:00100000:2.0:1788802141.329529:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892098944 00000100:00100000:2.0:1788802141.329557:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788802141.329563:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6856:x1875694892098944:12345-0@lo:502: 00000100:00100000:2.0:1788802141.329709:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:6856:x1875694892098944:12345-0@lo:502: Request processed in 144us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.329716:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788802141.329754:0:6856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6856:1875694892098944:0@lo:502: 00000040:00080000:2.0:1788802141.329773:0:6856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788802141.330142:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788802141.330160:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788802141.330170:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.330183:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802141.330192:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788802141.330201:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff910d054ea800 from 4 10000000:01000000:1.0:1788802141.330205:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788802141.330234:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.330269:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.330279:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802141.330293:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892099072:0@lo:101: 00000100:00100000:1.0:1788802141.330326:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802141.330352:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d056519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802141.330478:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892099072 00000100:00100000:2.0:1788802141.330483:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892099072 00000100:00100000:2.0:1788802141.330518:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788802141.330534:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892099072:12345-0@lo:101: 00010000:00010000:2.0:1788802141.330544:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802141.330556:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bbfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bbf5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802141.330577:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bbfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbf5 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802141.330587:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bbfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbf5 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802141.330595:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d029d7a00, rc 0) 00000100:00100000:2.0:1788802141.330642:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892099072:12345-0@lo:101: Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.330648:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788802141.330768:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892099072:0@lo:101: 00010000:00010000:3.0:1788802141.330780:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802141.330789:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802141.330837:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3383ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892099200:0@lo:256: 00000100:00100000:3.0:1788802141.330870:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802141.330906:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d082bfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788802141.331033:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892099200 00000100:00100000:2.0:1788802141.331038:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892099200 00000100:00100000:2.0:1788802141.331069:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788802141.331076:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892099200:12345-0@lo:256: 20000000:01000000:2.0:1788802141.331088:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788802141.331104:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788802141.331107:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788802141.331193:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892099200:12345-0@lo:256: Request processed in 117us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.331199:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788802141.331286:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3383ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892099200:0@lo:256: 10000000:01000000:1.0:1788802141.331333:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788802141.331339:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.331346:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802141.331353:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788802141.331355:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788802141.331357:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788802141.331374:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.331381:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.331397:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802141.331409:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892099328:0@lo:101: 00000100:00100000:1.0:1788802141.331441:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802141.331457:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d056519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802141.332163:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892099328 00000100:00100000:2.0:1788802141.332169:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892099328 00000100:00100000:2.0:1788802141.332199:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788802141.332206:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892099328:12345-0@lo:101: 00010000:00010000:2.0:1788802141.332221:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802141.332233:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d029d6a00/0x6ecba1490fc9bc0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bc03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802141.332270:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d029d6a00/0x6ecba1490fc9bc0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc03 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802141.332279:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d029d6a00/0x6ecba1490fc9bc0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc03 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802141.332287:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d029d6a00, rc 0) 00000100:00100000:2.0:1788802141.332329:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892099328:12345-0@lo:101: Request processed in 123us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.332335:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788802141.332369:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892099328:0@lo:101: 00010000:00010000:2.0:1788802141.332381:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802141.332390:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802141.332440:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892099456:0@lo:501: 00000100:00100000:2.0:1788802141.332463:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802141.332484:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802141.332496:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892099456 00000100:00100000:2.0:1788802141.332499:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892099456 00000100:00100000:2.0:1788802141.332514:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788802141.332519:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892099456:12345-0@lo:501: 00000100:00100000:2.0:1788802141.332763:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892099456:12345-0@lo:501: Request processed in 242us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.332770:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788802141.332796:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892099456:0@lo:501: 00000100:00100000:2.0:1788802141.332820:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892099584:0@lo:503: 00000100:00100000:2.0:1788802141.332854:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802141.332866:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802141.332877:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892099584 00000100:00100000:2.0:1788802141.332880:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892099584 00000100:00100000:2.0:1788802141.333087:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788802141.333095:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892099584:12345-0@lo:503: 00000100:00100000:2.0:1788802141.333395:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892099584:12345-0@lo:503: Request processed in 301us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.333403:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788802141.333440:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892099584:0@lo:503: 00000100:00100000:2.0:1788802141.333624:0:6858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6858:1875694892099712:0@lo:502: 00000100:00100000:2.0:1788802141.333657:0:6858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802141.333677:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892099712 00000100:00100000:2.0:1788802141.333680:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892099712 00000100:00100000:2.0:1788802141.333697:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788802141.333702:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:6858:x1875694892099712:12345-0@lo:502: 00000100:00100000:2.0:1788802141.333863:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:6858:x1875694892099712:12345-0@lo:502: Request processed in 160us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.333869:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788802141.333915:0:6858:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72480 going to sleep for 11 seconds 00000100:00100000:2.0:1788802141.333931:0:6858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6858:1875694892099712:0@lo:502: 00000020:01000000:2.0:1788802141.333950:0:6858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788802141.333957:0:6858:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788802141.333963:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802141.333966:0:6858:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788802141.333970:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788802141.333974:0:6858:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.157@tcp to nid 0x20000c0a8c99d (192.168.201.157@tcp) 00000020:01000000:2.0:1788802141.333994:0:6858:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788802141.333996:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788802141.334019:0:6858:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff910d07c40000) 00000020:00000080:2.0:1788802141.334038:0:6858:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788802141.334043:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788802141.334114:0:6858:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788802141.334119:0:6858:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788802141.334126:0:6858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9bc18 00010000:00080000:2.0:1788802141.334152:0:6858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff910d08369000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788802141.334396:0:6858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788802141.414949:0:6858:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788802141.414975:0:6858:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788802141.415825:0:6858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788802141.416012:0:6858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788802141.416062:0:6858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788802141.416122:0:6858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788802141.423452:0:6865:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802141.423459:0:6865:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788802141.424087:0:6858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788802141.424101:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788802141.424148:0:6858:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788802141.424176:0:6858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6ecba1490fc9bc1f 00000100:00080000:3.0:1788802141.424187:0:6858:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788802141.424200:0:6858:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff910d08369000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788802141.424279:0:6858:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d33838a80 x1875694892099840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788802141.424308:0:6858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788802141.424375:0:6858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802141.424381:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802141.424383:0:6858:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788802141.424386:0:6858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788802141.424390:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802141.424392:0:6858:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788802141.424396:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788802141.424398:0:6858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788802141.424429:0:6858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3383b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6858:1875694892099968:0@lo:502: 00000100:00100000:3.0:1788802141.424751:0:6858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802141.424854:0:6858:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d082bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802141.424918:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3383b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892100096:0@lo:400: 00000100:00100000:3.0:1788802141.424951:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802141.424973:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788802141.424979:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3383a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892100224:0@lo:400: 00000100:00100000:3.0:1788802141.425003:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802141.425106:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892099840:0@lo:8: 00000100:00100000:2.0:1788802141.425141:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802141.425182:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892099968 00000100:00100000:2.0:1788802141.425187:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892099968 00000100:00100000:2.0:1788802141.425225:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788802141.425233:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:6858:x1875694892099968:12345-0@lo:502: 00000100:00100000:3.0:1788802141.425658:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892099840 00000100:00100000:3.0:1788802141.425663:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892099840 00000100:00100000:3.0:1788802141.425688:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788802141.425693:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875694892099840:12345-0@lo:8: 00010000:00080000:3.0:1788802141.425713:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:3.0:1788802141.425736:0:6687:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6ecba1490fc9bc26 00002000:00100000:3.0:1788802141.425776:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff910d0450e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788802141.425780:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788802141.425785:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788802141.425889:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:6858:x1875694892099968:12345-0@lo:502: Request processed in 655us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.425897:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788802141.425937:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892100096 00000100:00100000:2.0:1788802141.425941:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892100096 00000100:00100000:2.0:1788802141.425964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892100224 00000100:00100000:2.0:1788802141.425972:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892100224 00000100:00100000:2.0:1788802141.425995:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788802141.426001:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892100096:12345-0@lo:400: 00000100:00100000:2.0:1788802141.426037:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892100096:12345-0@lo:400: Request processed in 36us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.426042:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788802141.426052:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788802141.426057:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892100224:12345-0@lo:400: 00000100:00100000:2.0:1788802141.426080:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892100224:12345-0@lo:400: Request processed in 24us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.426085:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788802141.426120:0:6858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3383b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:6858:1875694892099968:0@lo:502: 00000020:01000000:2.0:1788802141.426151:0:6858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802141.426157:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802141.426159:0:6858:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788802141.426164:0:6858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:2.0:1788802141.426285:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788802141.426310:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d3383a300 x1875694892100224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802141.426320:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3383a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892100224:0@lo:400: 00010000:00080000:2.0:1788802141.426329:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d3383b800 x1875694892100096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802141.426337:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3383b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892100096:0@lo:400: 00000020:01000000:2.0:1788802141.426352:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788802141.426369:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788802141.426379:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802141.426396:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802141.426406:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788802141.426409:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff910d10cbcd40 from 1 10000000:01000000:2.0:1788802141.426412:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788802141.426437:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802141.426444:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802141.426451:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802141.426465:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892100352:0@lo:101: 00002000:00100000:3.0:1788802141.426782:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788802141.427513:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788802141.427553:0:6687:0:(import.c:65:import_set_state_nolock()) ffff910d0450b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802141.427639:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875694892099840:12345-0@lo:8: Request processed in 1943us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802141.427648:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788802141.427840:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802141.427875:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72000 going to sleep for 11 seconds 00010000:00080000:0.0:1788802141.428743:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d33838a80 x1875694892099840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788802151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802141.428756:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788802141.428771:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788802141.428780:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788802141.428785:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788802141.428789:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d08369000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788802141.428821:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788802141.428826:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892099840:0@lo:8: 00000004:00080000:3.0:1788802141.430025:0:6865:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788802141.430198:0:6865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 194376958692ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788802141.436018:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892100352 00000100:00100000:1.0:1788802141.436035:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892100352 00000100:00100000:1.0:1788802141.436091:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788802141.436101:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892100352:12345-0@lo:101: 00010000:00010000:1.0:1788802141.436120:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802141.436141:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bc34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bc2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.436170:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc2d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.436181:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc2d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.436190:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01681800, rc 0) 00000100:00100000:1.0:1788802141.436309:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892100352:12345-0@lo:101: Request processed in 209us (8468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802141.436315:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788802141.436394:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892100352:0@lo:101: 00010000:00010000:1.0:1788802141.436412:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.436437:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802141.436530:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892100480:0@lo:501: 00000100:00100000:1.0:1788802141.436566:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802141.436594:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d126a8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788802141.436618:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892100480 00000100:00100000:1.0:1788802141.436621:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892100480 00000100:00100000:1.0:1788802141.436642:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788802141.436648:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892100480:12345-0@lo:501: 00000100:00100000:1.0:1788802141.436886:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892100480:12345-0@lo:501: Request processed in 237us (319us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788802141.436893:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788802141.436925:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892100480:0@lo:501: 10000000:01000000:1.0:1788802141.436949:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788802141.436956:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802141.436965:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788802141.510106:0:6866:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788802141.510145:0:6866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6866:1875694892100736:0@lo:7: 00000100:00100000:1.0:1788802141.510214:0:6866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802141.510293:0:6866:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d126a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788802141.510362:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892100608:0@lo:13: 00000100:00100000:1.0:1788802141.510394:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802141.510443:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892100736 00000100:00100000:1.0:1788802141.510451:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892100736 00000100:00100000:1.0:1788802141.510521:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788802141.510531:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6866:x1875694892100736:12345-0@lo:7: 00000100:00080000:2.0:1788802141.514470:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802141.514502:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892100608 00000100:00100000:2.0:1788802141.514633:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892100608 00000100:00100000:2.0:1788802141.514839:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788802141.514851:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875694892100608:12345-0@lo:13: 00002000:00000024:2.0:1788802141.514961:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788802141.515057:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875694892100608:12345-0@lo:13: Request processed in 209us (4662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802141.515064:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788802141.515288:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d063d7b80 x1875694892100608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802141.515303:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892100608:0@lo:13: 00002000:00080000:0.0:1788802141.519290:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788802141.519298:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788802141.519484:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6866:x1875694892100736:12345-0@lo:7: Request processed in 8950us (9265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802141.519495:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788802141.519586:0:6866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d063d6d80 x1875694892100736/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788802157 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802141.519609:0:6866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6866:1875694892100736:0@lo:7: 00000004:00080000:1.0:1788802141.519624:0:6866:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788802141.519686:0:6866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6866:1875694892100864:0@lo:5: 00000100:00100000:1.0:1788802141.519720:0:6866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802141.519782:0:6866:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d41b92600 going to sleep for 11 seconds 00000100:00100000:1.0:1788802141.519804:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892100864 00000100:00100000:1.0:1788802141.519810:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892100864 00000100:00100000:1.0:1788802141.519846:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788802141.519854:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6866:x1875694892100864:12345-0@lo:5: 00002000:00080000:1.0:1788802141.519874:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788802141.519877:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788802141.520269:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6866:x1875694892100864:12345-0@lo:5: Request processed in 415us (548us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788802141.520274:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788802141.520330:0:6866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d063d6d80 x1875694892100864/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788802157 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802141.520339:0:6866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6866:1875694892100864:0@lo:5: 00000004:00080000:0.0:1788802141.520345:0:6866:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788802141.520366:0:6866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6866:1875694892100992:0@lo:700: 00000100:00100000:0.0:1788802141.520385:0:6866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802141.520403:0:6866:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1ab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802141.520438:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892100992 00000100:00100000:1.0:1788802141.520441:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892100992 00000100:00100000:1.0:1788802141.520465:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802141.520469:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6866:x1875694892100992:12345-0@lo:700: 00000100:00100000:1.0:1788802141.520489:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1875694892101120:0@lo:700: 00000100:00100000:1.0:1788802141.520517:0:6696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802141.520532:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d41b92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788802141.520549:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892101120 00000100:00100000:1.0:1788802141.520553:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892101120 00000100:00100000:1.0:1788802141.520578:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802141.520584:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1875694892101120:12345-0@lo:700: 00000004:00080000:0.0:1788802141.557767:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788802141.582080:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788802141.587532:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1875694892101120:12345-0@lo:700: Request processed in 66928us (66994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802141.587556:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788802141.587743:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d063d5500 x1875694892101120/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788802157 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802141.587760:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1875694892101120:0@lo:700: 40000000:02000000:1.0:1788802141.587773:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788802141.644139:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788802141.644160:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788802141.644371:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6866:x1875694892100992:12345-0@lo:700: Request processed in 123894us (123977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802141.644391:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788802141.644620:0:6866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3d180 x1875694892100992/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788802157 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802141.644635:0:6866:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788802141.644656:0:6866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6866:1875694892100992:0@lo:700: 00000004:02000040:1.0:1788802141.669578:0:6866:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788802141.673744:0:6866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6866:1875694892101248:0@lo:5: 00000100:00100000:2.0:1788802141.674382:0:6866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802141.674465:0:6866:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788802141.674616:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892101248 00000100:00100000:0.0:1788802141.674625:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892101248 00000100:00100000:0.0:1788802141.674680:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788802141.674690:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6866:x1875694892101248:12345-0@lo:5: 00002000:00080000:0.0:1788802141.682359:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788802141.682385:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788802141.687217:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6866:x1875694892101248:12345-0@lo:5: Request processed in 12521us (12831us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788802141.687231:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788802141.687836:0:6866:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d3a18d880 x1875694892101248/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788802157 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802141.687856:0:6866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6866:1875694892101248:0@lo:5: 00000004:00080000:2.0:1788802141.687871:0:6866:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788802142.284450:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802143.309100:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802144.334060:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788802145.086197:0:7056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788802145.358073:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802146.380485:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802146.700406:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802146.700440:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892101376:0@lo:13: 00000100:00100000:0.0:1788802146.700517:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802146.700587:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892101376 00000100:00100000:0.0:1788802146.700595:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892101376 00000100:00100000:0.0:1788802146.700660:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788802146.700669:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892101376:12345-0@lo:13: 00002000:00000024:0.0:1788802146.700702:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802146.700749:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892101376:12345-0@lo:13: Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802146.700757:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788802146.700778:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802146.700808:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3f480 x1875694892101376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802146.700827:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892101376:0@lo:13: 00000100:00100000:3.0:1788802146.706158:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892101504:0@lo:400: 00000100:00100000:3.0:1788802146.706264:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802146.706317:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788802146.706323:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892101632:0@lo:400: 00000100:00100000:3.0:1788802146.706352:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802146.706381:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892101760:0@lo:400: 00000100:00100000:3.0:1788802146.706403:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802146.707559:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892101632 00000100:00100000:2.0:1788802146.707572:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892101632 00000100:00100000:2.0:1788802146.707632:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892101760 00000100:00100000:2.0:1788802146.707636:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892101760 00000100:00100000:2.0:1788802146.707668:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788802146.707677:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892101632:12345-0@lo:400: 00000100:00080000:0.0:1788802146.708938:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802146.709428:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892101504 00000100:00100000:1.0:1788802146.709444:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892101504 00000100:00100000:1.0:1788802146.709492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788802146.709502:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3313:x1875694892101504:12345-0@lo:400: 00000100:00100000:2.0:1788802146.717532:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892101632:12345-0@lo:400: Request processed in 9844us (11166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802146.717548:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788802146.717587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802146.717601:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892101760:12345-0@lo:400: 00000100:00100000:2.0:1788802146.717669:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892101760:12345-0@lo:400: Request processed in 75us (11265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802146.717676:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788802146.717729:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d33838380 x1875694892101760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802146.717745:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892101760:0@lo:400: 00010000:00080000:0.0:1788802146.721146:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d33839180 x1875694892101632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802146.721166:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892101632:0@lo:400: 00000100:00100000:1.0:1788802146.725162:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3313:x1875694892101504:12345-0@lo:400: Request processed in 15652us (18889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802146.725176:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788802146.725678:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892101504:0@lo:400: 00000001:00080000:1.0:1788802146.827559:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788802147.404570:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802148.431065:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802149.459553:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802150.478127:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802151.503456:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802151.820941:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892102016:0@lo:400: 00000100:00100000:0.0:1788802151.821070:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802151.823425:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788802151.823453:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892102144:0@lo:400: 00000100:00100000:0.0:1788802151.823521:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802151.823587:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892102016 00000100:00100000:0.0:1788802151.823596:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892102016 00000100:00100000:0.0:1788802151.823720:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892102144 00000100:00100000:0.0:1788802151.823725:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892102144 00000100:00100000:0.0:1788802151.823752:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788802151.823761:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892102016:12345-0@lo:400: 00000100:00100000:0.0:1788802151.823815:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892102016:12345-0@lo:400: Request processed in 54us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802151.823822:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788802151.823838:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788802151.823843:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892102144:12345-0@lo:400: 00000100:00100000:0.0:1788802151.823866:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892102144:12345-0@lo:400: Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802151.823871:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788802151.824473:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892101888:0@lo:400: 00000100:00100000:2.0:1788802151.824515:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802151.824549:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788802151.824555:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892102272:0@lo:400: 00000100:00100000:2.0:1788802151.824580:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802151.824628:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892101888 00000100:00100000:2.0:1788802151.824633:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892101888 00000100:00100000:2.0:1788802151.824667:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788802151.824673:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3312:x1875694892101888:12345-0@lo:400: 00000100:00100000:2.0:1788802151.824709:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3312:x1875694892101888:12345-0@lo:400: Request processed in 36us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802151.824715:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788802151.824759:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892101888:0@lo:400: 00000100:00080000:3.0:1788802151.833319:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802151.833356:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892102272 00000100:00100000:3.0:1788802151.833366:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892102272 00000100:00100000:3.0:1788802151.833437:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788802151.833454:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892102272:12345-0@lo:400: 00000100:00100000:3.0:1788802151.833543:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892102272:12345-0@lo:400: Request processed in 91us (8961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802151.833551:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788802151.833567:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788802151.833598:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3c700 x1875694892102144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802151.833623:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892102144:0@lo:400: 00010000:00080000:3.0:1788802151.833637:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3e680 x1875694892102016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802151.833646:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892102016:0@lo:400: 00000100:00100000:0.0:1788802151.844685:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802151.844715:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892102400:0@lo:13: 00000100:00100000:0.0:1788802151.844790:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788802151.844875:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3c000 x1875694892102272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802151.847202:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788802151.847227:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892102272:0@lo:400: 00000100:00100000:3.0:1788802151.852277:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892102400 00000100:00100000:3.0:1788802151.852294:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892102400 00000100:00100000:3.0:1788802151.852362:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788802151.852372:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892102400:12345-0@lo:13: 00002000:00000024:3.0:1788802151.852408:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802151.852501:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892102400:12345-0@lo:13: Request processed in 130us (7710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802151.852508:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788802151.856566:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d063d6d80 x1875694892102400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802151.856632:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892102400:0@lo:13: 00010000:00010000:2.0:1788802152.525105:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802153.551201:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802154.575482:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802155.601981:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802156.622571:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802156.940389:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892102656:0@lo:400: 00000100:00100000:0.0:1788802156.940466:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802156.940800:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892103040:0@lo:13: 00000100:00100000:3.0:1788802156.940839:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802156.940899:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788802156.940909:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892102528:0@lo:400: 00000100:00100000:0.0:1788802156.940939:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802156.940970:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892102784:0@lo:400: 00000100:00100000:0.0:1788802156.940994:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802156.941012:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802156.941017:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892102912:0@lo:400: 00000100:00100000:0.0:1788802156.941039:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802156.941075:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892102656 00000100:00100000:0.0:1788802156.941083:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892102656 00000100:00100000:0.0:1788802156.941124:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892102784 00000100:00100000:0.0:1788802156.941127:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892102784 00000100:00100000:0.0:1788802156.941152:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788802156.941160:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892102656:12345-0@lo:400: 00000100:00100000:0.0:1788802156.941207:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892102656:12345-0@lo:400: Request processed in 48us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802156.941213:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788802156.941228:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788802156.941234:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892102784:12345-0@lo:400: 00000100:00100000:0.0:1788802156.941301:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892102784:12345-0@lo:400: Request processed in 68us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802156.941307:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788802156.941405:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892102528 00000100:00100000:0.0:1788802156.941410:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892102528 00000100:00100000:0.0:1788802156.941441:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788802156.941448:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3314:x1875694892102528:12345-0@lo:400: 00000100:00100000:0.0:1788802156.941480:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3314:x1875694892102528:12345-0@lo:400: Request processed in 32us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802156.941485:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788802156.941515:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788802156.941623:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3e300 x1875694892102784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802156.941637:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892102784:0@lo:400: 00000100:00100000:0.0:1788802156.941661:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892102528:0@lo:400: 00010000:00080000:0.0:1788802156.941671:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3f100 x1875694892102656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802156.941679:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892102656:0@lo:400: 00000100:00100000:2.0:1788802156.941859:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892102912 00000100:00100000:2.0:1788802156.941865:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892102912 00000100:00100000:2.0:1788802156.941910:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788802156.941918:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892102912:12345-0@lo:400: 00000100:00100000:2.0:1788802156.941959:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892102912:12345-0@lo:400: Request processed in 43us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802156.941965:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788802156.941993:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3df80 x1875694892102912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802156.942002:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892102912:0@lo:400: 00000100:00080000:1.0:1788802156.942865:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788802156.943664:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892103040 00000100:00100000:1.0:1788802156.943674:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892103040 00000100:00100000:1.0:1788802156.943717:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788802156.943727:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892103040:12345-0@lo:13: 00002000:00000024:1.0:1788802156.943757:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802156.950265:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892103040:12345-0@lo:13: Request processed in 6508us (9392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802156.950280:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788802156.953287:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d063d5500 x1875694892103040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802156.953313:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892103040:0@lo:13: 00000020:01000004:3.0:1788802157.126616:0:7619:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788802157.126621:0:7619:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788802157.126750:0:7619:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff910d0450e000 00000020:01000004:3.0:1788802157.126767:0:7619:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788802157.126779:0:7619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788802157.126793:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff910d347c99c0) 00000020:00000080:3.0:1788802157.126810:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788802157.152965:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788802157.153221:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788802157.173694:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788802157.178950:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788802157.178986:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788802157.179051:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788802157.179080:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788802157.179530:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788802157.179543:0:7619:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788802157.179552:0:7619:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6ecba1490fc9bc42 00000020:01000004:3.0:1788802157.179561:0:7619:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788802157.179582:0:7619:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.157@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788802157.179587:0:7619:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788802157.179593:0:7619:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788802157.179614:0:7619:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788802157.179619:0:7619:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788802157.204301:0:7619:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788802157.204355:0:7619:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.157@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788802157.204360:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788802157.204362:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788802157.204363:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788802157.204364:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788802157.204366:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788802157.204367:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788802157.204368:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788802157.204370:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788802157.204371:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788802157.204372:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788802157.204373:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788802157.204377:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788802157.204379:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788802157.204380:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788802157.204381:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788802157.204383:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788802157.204384:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788802157.204385:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788802157.204386:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788802157.204387:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788802157.204388:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788802157.204389:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788802157.204390:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788802157.204427:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788802157.204447:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892103168:0@lo:253: 00000100:00100000:2.0:1788802157.204533:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.204592:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788802157.204903:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892103168 00000100:00100000:0.0:1788802157.204912:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892103168 00000100:00100000:0.0:1788802157.204968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788802157.204979:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:7619:x1875694892103168:12345-0@lo:253: 20000000:01000000:0.0:1788802157.205009:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788802157.205014:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788802157.205018:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788802157.205022:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788802157.206176:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788802157.207090:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788802157.207111:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788802157.207163:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788802157.207173:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788802157.207222:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788802157.207317:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788802157.207953:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788802157.207975:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.157@tcp 20000000:01000000:1.0:1788802157.207977:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.157@tcp (null) (null) (null) 00000040:00080000:1.0:1788802157.208014:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788802157.208022:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788802157.208072:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788802157.208082:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.157@tcp (null) (null) 00000040:00080000:1.0:1788802157.208135:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788802157.208145:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788802157.208178:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788802157.208485:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788802157.210772:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788802157.210803:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.157@tcp 20000000:01000000:1.0:1788802157.210806:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.157@tcp (null) (null) (null) 00000040:00080000:1.0:1788802157.210846:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788802157.210854:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788802157.210884:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788802157.210891:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.157@tcp (null) (null) 00000040:00080000:1.0:1788802157.210922:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788802157.210932:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788802157.210980:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788802157.211018:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788802157.211035:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788802157.211038:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788802157.211041:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788802157.211053:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788802157.211055:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788802157.211091:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788802157.211093:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788802157.215783:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788802157.215898:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788802157.215937:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788802157.220172:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788802157.220834:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788802157.220912:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788802157.220928:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788802157.220932:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788802157.224848:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788802157.224967:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788802157.225032:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788802157.226987:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788802157.227034:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788802157.227101:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788802157.227116:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788802157.227119:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788802157.230509:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788802157.231051:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788802157.231114:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788802157.231206:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788802157.231221:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788802157.231224:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788802157.233757:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788802157.233850:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788802157.233912:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788802157.234499:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788802157.234676:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788802157.234716:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788802157.234734:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788802157.234736:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788802157.234747:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788802157.234770:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.234790:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bb9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb93 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.234798:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bbc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbbd expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.234805:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d01681400/0x6ecba1490fc9bbee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbe7 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.234811:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d029d6a00/0x6ecba1490fc9bc0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc03 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.234818:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bc34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc2d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.234825:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.234868:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bc34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bc2d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.234906:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bc34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc2d expref: 16 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802157.234925:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875694892103296:0@lo:104: 00000100:00100000:2.0:1788802157.235012:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788802157.235068:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d029d6a00/0x6ecba1490fc9bc0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bc03 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.235078:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d029d6a00/0x6ecba1490fc9bc0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc03 expref: 16 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802157.235087:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875694892103424:0@lo:104: 00010000:00010000:2.0:1788802157.235112:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d01681400/0x6ecba1490fc9bbee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bbe7 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.235121:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d01681400/0x6ecba1490fc9bbee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbe7 expref: 16 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802157.235129:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875694892103552:0@lo:104: 00010000:00010000:2.0:1788802157.235155:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bbbd expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.235164:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bbc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbbd expref: 16 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802157.235173:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875694892103680:0@lo:104: 00010000:00010000:2.0:1788802157.235195:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bb93 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.235215:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bb9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb93 expref: 16 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802157.235225:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875694892103808:0@lo:104: 00000100:00100000:1.0:1788802157.236759:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788802157.236805:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.236842:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.236852:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.236866:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892103296 00000100:00100000:1.0:1788802157.236876:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892103296 00000100:00100000:1.0:1788802157.236915:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892103424 00000100:00100000:1.0:1788802157.236918:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892103424 00000100:00100000:1.0:1788802157.236927:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892103552 00000100:00100000:1.0:1788802157.236929:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892103552 00000100:00100000:1.0:1788802157.236937:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892103680 00000100:00100000:1.0:1788802157.236939:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892103680 00000100:00100000:1.0:1788802157.236951:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788802157.236960:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d044d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+6:5837:x1875694892103296:12345-0@lo:104: 00010000:00010000:1.0:1788802157.236976:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237044:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788802157.237050:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d044d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+6:5837:x1875694892103296:12345-0@lo:104: Request processed in 91us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.237056:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788802157.237097:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788802157.237102:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:5837:x1875694892103424:12345-0@lo:104: 00010000:00010000:1.0:1788802157.237108:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237137:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788802157.237154:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:5837:x1875694892103424:12345-0@lo:104: Request processed in 52us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.237159:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788802157.237170:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788802157.237174:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:5837:x1875694892103552:12345-0@lo:104: 00010000:00010000:1.0:1788802157.237181:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237224:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788802157.237229:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:5837:x1875694892103552:12345-0@lo:104: Request processed in 55us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.237234:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788802157.237263:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788802157.237268:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5837:x1875694892103680:12345-0@lo:104: 00010000:00010000:1.0:1788802157.237275:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237298:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788802157.237302:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5837:x1875694892103680:12345-0@lo:104: Request processed in 35us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.237306:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788802157.237352:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788802157.237359:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237366:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d6600 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802157.237370:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237389:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802157.237396:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802157.237401:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788802157.237436:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237443:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802157.237463:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237469:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d029d6600/0x6ecba1490fc9bc2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237483:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788802157.237486:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237491:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01680200 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802157.237493:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237499:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802157.237505:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802157.237517:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788802157.237531:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237536:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802157.237551:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237557:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d01680200/0x6ecba1490fc9bc03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc0a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237569:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788802157.237571:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237576:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1a00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802157.237579:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237586:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802157.237591:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802157.237596:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788802157.237607:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237613:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802157.237623:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237630:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d206f1a00/0x6ecba1490fc9bbe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbee expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237640:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802157.237643:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237648:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01680a00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802157.237651:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237657:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802157.237663:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802157.237667:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788802157.237679:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237684:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802157.237689:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237694:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d01680a00/0x6ecba1490fc9bbbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbc4 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.237702:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802157.237710:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802157.237711:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802157.237718:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802157.237723:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802157.237744:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892103936:0@lo:103: 00000100:00100000:1.0:1788802157.237776:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.237781:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802157.237857:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892103808 00000100:00100000:3.0:1788802157.237863:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892103808 00000100:00100000:3.0:1788802157.237887:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788802157.237893:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5837:x1875694892103808:12345-0@lo:104: 00010000:00010000:3.0:1788802157.237909:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.237943:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788802157.237948:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5837:x1875694892103808:12345-0@lo:104: Request processed in 55us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802157.237953:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788802157.238016:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788802157.238023:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892104320:0@lo:103: 00000100:00100000:1.0:1788802157.238046:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.238083:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892104064:0@lo:103: 00000100:00100000:1.0:1788802157.238103:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.238119:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788802157.238124:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892104192:0@lo:103: 00000100:00100000:1.0:1788802157.238142:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802157.238149:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892103936 00000100:00100000:0.0:1788802157.238154:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892103936 00000100:00100000:1.0:1788802157.238159:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892104320 00000100:00100000:1.0:1788802157.238161:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892104320 00010000:00010000:1.0:1788802157.238176:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bbc4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbbd expref: 18 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.238176:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bc34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc2d expref: 18 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802157.238190:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892104064 00000100:00100000:1.0:1788802157.238192:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892104064 00000100:00100000:0.0:1788802157.238192:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892104192 00000100:00100000:0.0:1788802157.238194:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892104192 00010000:00010000:1.0:1788802157.238201:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d029d6a00/0x6ecba1490fc9bc0a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc03 expref: 20 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802157.238213:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788802157.238219:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+20:3314:x1875694892104320:12345-0@lo:103: 00010000:00010000:1.0:1788802157.238228:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802157.238234:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bbc4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbbd expref: 20 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238271:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bbc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbbd expref: 20 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238287:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802157.238315:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+20:3314:x1875694892104320:12345-0@lo:103: Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.238332:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788802157.238341:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d01681400/0x6ecba1490fc9bbee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbe7 expref: 19 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802157.238345:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788802157.238351:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892103936:12345-0@lo:103: 00000100:00100000:0.0:1788802157.238354:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788802157.238357:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788802157.238359:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788802157.238361:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bc34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc2d expref: 19 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238370:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bc34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc2d expref: 19 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238379:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802157.238399:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892103936:12345-0@lo:103: Request processed in 48us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.238404:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788802157.238416:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788802157.238422:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:3311:x1875694892104064:12345-0@lo:103: 00010000:00010000:1.0:1788802157.238428:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802157.238432:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d029d6a00/0x6ecba1490fc9bc0a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc03 expref: 18 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238440:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d029d6a00/0x6ecba1490fc9bc0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc03 expref: 18 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238455:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802157.238481:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:3311:x1875694892104064:12345-0@lo:103: Request processed in 59us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.238487:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788802157.238498:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788802157.238504:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:3311:x1875694892104192:12345-0@lo:103: 00010000:00010000:1.0:1788802157.238510:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802157.238514:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d01681400/0x6ecba1490fc9bbee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbe7 expref: 17 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238521:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d01681400/0x6ecba1490fc9bbee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbe7 expref: 17 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238530:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802157.238549:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:3311:x1875694892104192:12345-0@lo:103: Request processed in 45us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.238554:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788802157.238585:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892104192:0@lo:103: 00000100:00100000:1.0:1788802157.238594:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892104064:0@lo:103: 00000100:00100000:1.0:1788802157.238618:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892104320:0@lo:103: 00000100:00100000:1.0:1788802157.238624:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892103936:0@lo:103: 00010000:00010000:1.0:1788802157.238635:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802157.238638:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238654:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681a00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802157.238657:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238663:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802157.238669:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802157.238674:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788802157.238694:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238699:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802157.238708:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.238715:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bb93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb9a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802157.238722:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892104448:0@lo:103: 00010000:00010000:1.0:1788802157.238728:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802157.238730:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802157.238731:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802157.238747:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.239004:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892104448 00000100:00100000:1.0:1788802157.239009:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892104448 00010000:00010000:1.0:1788802157.239022:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bb9a lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb93 expref: 17 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802157.239040:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788802157.239050:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:3314:x1875694892104448:12345-0@lo:103: 00010000:00010000:1.0:1788802157.239057:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802157.239061:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bb9a lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb93 expref: 17 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239070:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bb9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb93 expref: 17 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239082:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239090:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239102:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239110:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239117:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239123:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239128:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d6e00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802157.239132:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239139:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239153:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.239162:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802157.239187:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:3314:x1875694892104448:12345-0@lo:103: Request processed in 137us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.239192:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788802157.239231:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892104448:0@lo:103: 00000100:00100000:0.0:1788802157.244011:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337d480 going to sleep for 11 seconds 00010000:00010000:0.0:1788802157.244062:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bc34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bc2d expref: 16 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802157.244082:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875694892103296:0@lo:104: 00010000:00010000:0.0:1788802157.244094:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d029d6a00/0x6ecba1490fc9bc0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bc03 expref: 15 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802157.244109:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875694892103424:0@lo:104: 00010000:00010000:0.0:1788802157.244118:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01681400/0x6ecba1490fc9bbee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bbe7 expref: 14 pid: 5836 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802157.244127:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875694892103552:0@lo:104: 00010000:00010000:0.0:1788802157.244137:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bbc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bbbd expref: 13 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802157.244147:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875694892103680:0@lo:104: 00010000:00010000:0.0:1788802157.244156:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bb9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bb93 expref: 12 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802157.244179:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875694892103808:0@lo:104: 00010000:00010000:0.0:1788802157.249727:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.249749:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.249756:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.249763:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bc49 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788802157.249782:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788802157.318857:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:7619:x1875694892103168:12345-0@lo:253: Request processed in 113870us (114315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802157.318871:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788802157.318978:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892103168:0@lo:253: 10000000:01000000:2.0:1788802157.318994:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788802157.318998:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788802157.319000:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788802157.319001:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788802157.319002:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788802157.319003:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788802157.319004:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788802157.319006:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788802157.319007:0:7619:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788802157.319009:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788802157.319010:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788802157.319029:0:7619:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910d0450e000 from lustre-OST0001 10000000:01000000:2.0:1788802157.319057:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788802157.319060:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788802157.319067:0:7619:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff910d10cbcd40 local copy 10000000:01000000:2.0:1788802157.319071:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788802157.319105:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.319118:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.319128:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802157.319167:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892104576:0@lo:101: 00000100:00100000:2.0:1788802157.319204:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.319293:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d358d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802157.319417:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892104576 00000100:00100000:0.0:1788802157.319424:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892104576 00000100:00100000:0.0:1788802157.319460:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788802157.319470:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:7619:x1875694892104576:12345-0@lo:101: 00010000:00010000:0.0:1788802157.319483:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802157.319497:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bc57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bc50 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.319662:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bc57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc50 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.319675:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bc57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc50 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.319692:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0c00, rc 0) 00000100:00100000:0.0:1788802157.319738:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892104576:12345-0@lo:101: Request processed in 269us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802157.319744:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788802157.319868:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892104576:0@lo:101: 00010000:00010000:2.0:1788802157.319881:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.319891:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802157.319985:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892104704:0@lo:501: 00000100:00100000:2.0:1788802157.320011:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.320036:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d358d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802157.320085:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892104704 00000100:00100000:0.0:1788802157.320089:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892104704 00000100:00100000:0.0:1788802157.320121:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788802157.320129:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892104704:12345-0@lo:501: 00000100:00100000:0.0:1788802157.320368:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892104704:12345-0@lo:501: Request processed in 239us (355us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788802157.320375:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788802157.320572:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892104704:0@lo:501: 10000000:01000000:1.0:1788802157.320584:0:7619:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788802157.320612:0:7619:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788802157.320617:0:7619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.320626:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.320633:0:7619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.320651:0:7619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788802157.320668:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910d0450e000 10000000:01000000:1.0:1788802157.320673:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788802157.320677:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788802157.320679:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788802157.320683:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788802157.320686:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788802157.320714:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.320722:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.320731:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802157.320744:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892104832:0@lo:101: 00000100:00100000:1.0:1788802157.320773:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.320795:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788802157.320810:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802157.320817:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.320823:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d7c00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802157.320826:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.320834:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802157.320841:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802157.320847:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788802157.320865:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.320872:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802157.320897:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.320904:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bc50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6ecba1490fc9bc57 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.320918:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802157.320920:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802157.320922:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802157.320933:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892104960:0@lo:103: 00000100:00100000:1.0:1788802157.320962:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.320999:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892104960 00000100:00100000:1.0:1788802157.321003:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892104960 00000100:00100000:1.0:1788802157.321035:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788802157.321042:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:3311:x1875694892104960:12345-0@lo:103: 00010000:00010000:1.0:1788802157.321051:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802157.321062:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f0c00/0x6ecba1490fc9bc57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bc50 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.321075:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802157.321102:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:3311:x1875694892104960:12345-0@lo:103: Request processed in 61us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.321109:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788802157.321130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892104832 00000100:00100000:1.0:1788802157.321134:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892104832 00000100:00100000:1.0:1788802157.321472:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788802157.321480:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+11:7619:x1875694892104832:12345-0@lo:101: 00010000:00010000:1.0:1788802157.321489:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802157.321501:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bc65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bc5e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.321589:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bc65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc5e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.321599:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bc65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc5e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.321606:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01680a00, rc 0) 00000100:00100000:1.0:1788802157.321640:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892104832:12345-0@lo:101: Request processed in 162us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.321646:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788802157.321938:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892104960:0@lo:103: 00000100:00100000:1.0:1788802157.321968:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892104832:0@lo:101: 00010000:00010000:1.0:1788802157.321980:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.321988:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802157.322066:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105088:0@lo:501: 00000100:00100000:1.0:1788802157.322094:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.322157:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788802157.322190:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892105088 00000100:00100000:0.0:1788802157.322195:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892105088 00000100:00100000:0.0:1788802157.322279:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788802157.322287:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892105088:12345-0@lo:501: 00000100:00100000:0.0:1788802157.322732:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892105088:12345-0@lo:501: Request processed in 445us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802157.322740:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788802157.322838:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105088:0@lo:501: 00000100:00100000:3.0:1788802157.322876:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3383a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105216:0@lo:503: 00000100:00100000:3.0:1788802157.322917:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802157.323085:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788802157.323128:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892105216 00000100:00100000:1.0:1788802157.323133:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892105216 00000100:00100000:1.0:1788802157.323158:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788802157.323166:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892105216:12345-0@lo:503: 00000100:00100000:1.0:1788802157.323652:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892105216:12345-0@lo:503: Request processed in 486us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.323666:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788802157.323863:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3383a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105216:0@lo:503: 00000040:00080000:3.0:1788802157.324143:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788802157.324204:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3383a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105344:0@lo:502: 00000100:00100000:3.0:1788802157.324604:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.324742:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788802157.324783:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892105344 00000100:00100000:1.0:1788802157.324789:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892105344 00000100:00100000:1.0:1788802157.324869:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788802157.324878:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892105344:12345-0@lo:502: 00000100:00100000:1.0:1788802157.325064:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892105344:12345-0@lo:502: Request processed in 186us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.325071:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788802157.325152:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3383a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105344:0@lo:502: 00000040:00080000:2.0:1788802157.325697:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788802157.325752:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788802157.325790:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788802157.325842:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788802157.325884:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788802157.325923:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788802157.325955:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105472:0@lo:502: 00000100:00100000:2.0:1788802157.326002:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.326194:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d358d0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788802157.326527:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892105472 00000100:00100000:0.0:1788802157.326535:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892105472 00000100:00100000:0.0:1788802157.326572:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788802157.326581:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892105472:12345-0@lo:502: 00000100:00100000:0.0:1788802157.326768:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892105472:12345-0@lo:502: Request processed in 187us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802157.326776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788802157.326951:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105472:0@lo:502: 00000040:00080000:2.0:1788802157.327058:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788802157.327076:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788802157.327766:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788802157.327780:0:7626:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788802157.327786:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802157.327788:0:7626:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788802157.327795:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788802157.327810:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff910d10cb99c0) 00000020:00000080:0.0:1788802157.327830:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788802157.327836:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788802157.327897:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d0450e000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788802157.327904:0:7626:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788802157.327909:0:7626:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6ecba1490fc9bc73 00010000:00010000:0.0:1788802157.332664:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788802157.332965:0:7626:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788802157.336084:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788802157.336659:0:7626:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788802157.345182:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788802157.345889:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788802157.347353:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788802157.347365:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802157.347370:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802157.347372:0:7626:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788802157.347375:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788802157.347379:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802157.347380:0:7626:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788802157.347383:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788802157.347385:0:7626:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788802157.347641:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802157.347645:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802157.347647:0:7626:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788802157.347650:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788802157.350000:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788802157.350055:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788802157.350078:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.350093:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802157.351585:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d0450e000 from 1 10000000:01000000:0.0:1788802157.351593:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788802157.351638:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.351660:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.351672:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802157.351694:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105600:0@lo:101: 00000100:00100000:0.0:1788802157.351755:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802157.351847:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802157.353926:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892105600 00000100:00100000:3.0:1788802157.353939:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892105600 00000100:00100000:3.0:1788802157.354019:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788802157.354029:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:7619:x1875694892105600:12345-0@lo:101: 00010000:00010000:3.0:1788802157.354045:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802157.354061:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216f400/0x6ecba1490fc9bc81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bc7a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.354086:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216f400/0x6ecba1490fc9bc81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc7a expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.354097:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216f400/0x6ecba1490fc9bc81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc7a expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.354113:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216f400, rc 0) 00000100:00100000:3.0:1788802157.354179:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892105600:12345-0@lo:101: Request processed in 152us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802157.354185:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788802157.354367:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105600:0@lo:101: 00010000:00010000:0.0:1788802157.354384:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.354406:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802157.354693:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105728:0@lo:501: 00000100:00100000:0.0:1788802157.354731:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802157.355215:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788802157.360391:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892105728 00000100:00100000:1.0:1788802157.360404:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892105728 00000100:00100000:1.0:1788802157.360463:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788802157.360473:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892105728:12345-0@lo:501: 00000100:00100000:1.0:1788802157.360765:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892105728:12345-0@lo:501: Request processed in 293us (6032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.360773:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788802157.360831:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105728:0@lo:501: 00000100:00100000:1.0:1788802157.360879:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105856:0@lo:503: 00000100:00100000:1.0:1788802157.360918:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.363290:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788802157.363501:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892105856 00000100:00100000:3.0:1788802157.363590:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892105856 00000100:00100000:3.0:1788802157.363644:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788802157.363654:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892105856:12345-0@lo:503: 00000100:00100000:3.0:1788802157.364047:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892105856:12345-0@lo:503: Request processed in 393us (3126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802157.364056:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788802157.364284:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105856:0@lo:503: 00000040:00080000:1.0:1788802157.364606:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788802157.364672:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105984:0@lo:502: 00000100:00100000:1.0:1788802157.364708:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.364738:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788802157.364749:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892105984 00000100:00100000:3.0:1788802157.364754:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892105984 00000100:00100000:3.0:1788802157.364899:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788802157.364909:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892105984:12345-0@lo:502: 00000100:00100000:3.0:1788802157.365100:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892105984:12345-0@lo:502: Request processed in 192us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802157.365107:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788802157.365183:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892105984:0@lo:502: 00000040:00080000:1.0:1788802157.365826:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788802157.365881:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788802157.365913:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106112:0@lo:502: 00000100:00100000:1.0:1788802157.365956:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.366226:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788802157.366659:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892106112 00000100:00100000:2.0:1788802157.366666:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892106112 00000100:00100000:0.0:1788802157.366926:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788802157.366937:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892106112:12345-0@lo:502: 00000100:00100000:0.0:1788802157.367137:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892106112:12345-0@lo:502: Request processed in 201us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802157.367145:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788802157.367261:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106112:0@lo:502: 00000040:00080000:1.0:1788802157.367389:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788802157.367414:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788802157.368754:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788802157.368766:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802157.368768:0:7630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788802157.368773:0:7630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d0450e000 00000020:00000080:1.0:1788802157.368775:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788802157.368884:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788802157.368889:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802157.368890:0:7630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788802157.368894:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788802157.369012:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788802157.369039:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788802157.369061:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.369074:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802157.369113:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788802157.369117:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910d0450e000 10000000:01000000:2.0:1788802157.369119:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910d0450e000 10000000:01000000:2.0:1788802157.369123:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788802157.369128:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d0450e000 from 1 10000000:01000000:2.0:1788802157.369130:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788802157.369163:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.369172:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.369182:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802157.369209:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106240:0@lo:101: 00000100:00100000:2.0:1788802157.369301:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.369738:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11a073c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802157.369878:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892106240 00000100:00100000:3.0:1788802157.369885:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892106240 00000100:00100000:3.0:1788802157.369921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788802157.369928:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892106240:12345-0@lo:101: 00010000:00010000:3.0:1788802157.369942:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802157.369954:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216fa00/0x6ecba1490fc9bc8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bc88 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.369993:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216fa00/0x6ecba1490fc9bc8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc88 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.370003:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216fa00/0x6ecba1490fc9bc8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc88 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.370012:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216fa00, rc 0) 00000100:00100000:3.0:1788802157.370058:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7619:x1875694892106240:12345-0@lo:101: Request processed in 130us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802157.370064:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788802157.370155:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106240:0@lo:101: 00010000:00010000:2.0:1788802157.370168:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.370183:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802157.370306:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106368:0@lo:501: 00000100:00100000:2.0:1788802157.370342:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.370354:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11a073c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802157.370531:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892106368 00000100:00100000:3.0:1788802157.370535:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892106368 00000100:00100000:3.0:1788802157.370553:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788802157.370558:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7619:x1875694892106368:12345-0@lo:501: 00000100:00100000:3.0:1788802157.370779:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7619:x1875694892106368:12345-0@lo:501: Request processed in 220us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802157.370796:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788802157.370994:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106368:0@lo:501: 00000100:00100000:2.0:1788802157.371021:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106496:0@lo:503: 00000100:00100000:2.0:1788802157.371061:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.371091:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11a073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802157.371200:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892106496 00000100:00100000:0.0:1788802157.371205:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892106496 00000100:00100000:2.0:1788802157.371536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788802157.371544:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7619:x1875694892106496:12345-0@lo:503: 00000100:00100000:2.0:1788802157.371699:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7619:x1875694892106496:12345-0@lo:503: Request processed in 155us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802157.371706:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788802157.371746:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106496:0@lo:503: 00000040:00080000:2.0:1788802157.372120:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788802157.372180:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106624:0@lo:502: 00000100:00100000:2.0:1788802157.372219:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.372266:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11a073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802157.372280:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892106624 00000100:00100000:2.0:1788802157.372284:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892106624 00000100:00100000:2.0:1788802157.372312:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788802157.372333:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7619:x1875694892106624:12345-0@lo:502: 00000100:00100000:2.0:1788802157.372638:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7619:x1875694892106624:12345-0@lo:502: Request processed in 305us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802157.372645:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788802157.372688:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106624:0@lo:502: 00000040:00080000:2.0:1788802157.373058:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788802157.373104:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788802157.373140:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788802157.373188:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788802157.373226:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788802157.373335:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788802157.373377:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788802157.373649:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788802157.373702:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788802157.373740:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788802157.373776:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788802157.374670:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788802157.374711:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788802157.374743:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788802157.374789:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788802157.374823:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788802157.374855:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788802157.374924:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788802157.374958:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788802157.374983:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788802157.375019:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788802157.375062:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788802157.375090:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788802157.375128:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788802157.375159:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788802157.375190:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788802157.375600:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788802157.375656:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788802157.375689:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788802157.375738:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788802157.375774:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788802157.375806:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788802157.375841:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788802157.375903:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788802157.375941:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788802157.375988:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788802157.376023:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788802157.376069:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106752:0@lo:502: 00000100:00100000:2.0:1788802157.376144:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802157.376335:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11a073c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802157.376683:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892106752 00000100:00100000:1.0:1788802157.376691:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892106752 00000100:00100000:0.0:1788802157.377004:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788802157.377016:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7619:x1875694892106752:12345-0@lo:502: 00000100:00100000:0.0:1788802157.377384:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7619:x1875694892106752:12345-0@lo:502: Request processed in 369us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802157.377600:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788802157.377723:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892106752:0@lo:502: 00000040:00080000:2.0:1788802157.377826:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788802157.377839:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788802157.378867:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788802157.378889:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff910d418acd40) 00000020:00000080:1.0:1788802157.378913:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788802157.378997:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d0450e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788802157.379002:0:7631:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910d0450e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788802157.379004:0:7631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d0450e000 3 00010000:00080000:1.0:1788802157.379033:0:7631:0:(ldlm_lib.c:102:import_set_conn()) imp ffff910d3a670800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.157@tcp at head 00010000:00010000:0.0:1788802157.381814:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788802157.382139:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788802157.382178:0:7631:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788802157.382190:0:7631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6ecba1490fc9bc9d 00000100:00080000:0.0:1788802157.382200:0:7631:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788802157.382213:0:7631:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff910d3a670800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788802157.382283:0:7631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d10d3e300 x1875694892106880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788802157.382309:0:7631:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788802157.382751:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892107008:0@lo:400: 00000100:00100000:3.0:1788802157.382822:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.382979:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875694892106880:0@lo:38: 00000100:00100000:1.0:1788802157.383014:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.383056:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892107136:0@lo:400: 00000100:00100000:1.0:1788802157.383080:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.383099:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802157.383105:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892107264:0@lo:400: 00000100:00100000:1.0:1788802157.383129:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.383162:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892107008 00000100:00100000:1.0:1788802157.383169:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892107008 00000100:00100000:1.0:1788802157.383200:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892106880 00000100:00100000:1.0:1788802157.383203:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892106880 00000100:00100000:1.0:1788802157.383213:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892107136 00000100:00100000:1.0:1788802157.383215:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892107136 00000100:00100000:1.0:1788802157.383486:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788802157.383495:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892107008:12345-0@lo:400: 00000100:00100000:1.0:1788802157.383677:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892107008:12345-0@lo:400: Request processed in 182us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.383686:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788802157.383704:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788802157.383711:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892107136:12345-0@lo:400: 00000100:00100000:1.0:1788802157.383747:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892107136:12345-0@lo:400: Request processed in 37us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.383753:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788802157.383765:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788802157.383778:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875694892106880:12345-0@lo:38: 00010000:00080000:1.0:1788802157.383809:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1788802157.383840:0:5843:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6ecba1490fc9bca4 00000004:00100000:1.0:1788802157.383855:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788802157.383882:0:5843:0:(import.c:65:import_set_state_nolock()) ffff910d3a674800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788802157.383921:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875694892106880:12345-0@lo:38: Request processed in 141us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.383927:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788802157.383952:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892107264 00000100:00100000:1.0:1788802157.383956:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892107264 00000100:00100000:1.0:1788802157.383982:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788802157.383989:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892107264:12345-0@lo:400: 00000100:00100000:1.0:1788802157.384020:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892107264:12345-0@lo:400: Request processed in 32us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.384025:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788802157.384062:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3e300 x1875694892106880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788802167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802157.384073:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788802157.384081:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788802157.384089:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788802157.384094:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788802157.384097:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3a670800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788802157.384103:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875694892106880:0@lo:38: 00010000:00080000:1.0:1788802157.384133:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3ca80 x1875694892107264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802157.384143:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892107264:0@lo:400: 00010000:00080000:1.0:1788802157.384163:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3c000 x1875694892107136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802157.384172:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892107136:0@lo:400: 00000040:00080000:0.0:1788802157.384424:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1788802157.384858:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a688e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7632:1875694892107392:0@lo:901: 00000100:00100000:1.0:1788802157.384902:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.384936:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892107392 00000100:00100000:1.0:1788802157.384940:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892107392 00000100:00100000:1.0:1788802157.384989:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802157.384997:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7632:x1875694892107392:12345-0@lo:901: 00000100:00100000:1.0:1788802157.385367:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7632:x1875694892107392:12345-0@lo:901: Request processed in 370us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.385374:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788802157.385738:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802157.385778:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3d80 going to sleep for 11 seconds 00010000:00080000:1.0:1788802157.385800:0:7632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d3a688e00 x1875694892107392/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788802173 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802157.385812:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a688e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7632:1875694892107392:0@lo:901: 00000020:01000000:0.0:1788802157.386640:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788802157.386670:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788802157.386690:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802157.386703:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788802157.386753:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788802157.386755:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788802157.386756:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788802157.386758:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788802157.386759:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788802157.386765:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788802157.386766:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788802157.386768:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788802157.386769:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788802157.386770:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788802157.386772:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788802157.386775:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788802157.386778:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788802157.386779:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788802157.386780:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788802157.386781:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788802157.386782:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788802157.386783:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788802157.386784:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788802157.386785:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788802157.386787:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788802157.386788:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788802157.386788:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788802157.386818:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788802157.386833:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892107520:0@lo:253: 00000100:00100000:0.0:1788802157.386885:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802157.386925:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337d000 going to sleep for 11 seconds 00010000:00080000:3.0:1788802157.388465:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3f480 x1875694892107008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802157.388484:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892107008:0@lo:400: 00000100:00100000:3.0:1788802157.388604:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892107520 00000100:00100000:3.0:1788802157.388612:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892107520 00000100:00100000:3.0:1788802157.388654:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788802157.388662:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7619:x1875694892107520:12345-0@lo:253: 20000000:01000000:3.0:1788802157.388698:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788802157.388713:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788802157.417903:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788802157.417920:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788802157.419138:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788802157.419148:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788802157.419171:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.419190:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bbfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbf5 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.419199:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.419700:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bbfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bbf5 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.419715:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bbfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbf5 expref: 14 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802157.419730:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a688e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875694892107648:0@lo:104: 00000100:00100000:1.0:1788802157.419794:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.419832:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788802157.420054:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892107648 00000100:00100000:3.0:1788802157.420061:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892107648 00000100:00100000:3.0:1788802157.420111:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788802157.420121:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5858:x1875694892107648:12345-0@lo:104: 00010000:00010000:3.0:1788802157.420135:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.420189:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788802157.420195:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:5858:x1875694892107648:12345-0@lo:104: Request processed in 76us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802157.420202:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788802157.420225:0:6703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788802157.420231:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.420268:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681000 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:3.0:1788802157.420272:0:6703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.420281:0:6703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788802157.420288:0:6703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802157.420293:0:6703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788802157.420338:0:6703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.420346:0:6703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788802157.420364:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.420371:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d01681000/0x6ecba1490fc9bbf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbfc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802157.420388:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802157.421116:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802157.421119:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802157.421128:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802157.421144:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3383ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892107776:0@lo:103: 00000100:00100000:3.0:1788802157.421187:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802157.421277:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892107776 00000100:00100000:1.0:1788802157.421283:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892107776 00010000:00010000:1.0:1788802157.421308:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bbfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbf5 expref: 15 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802157.421347:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788802157.421355:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:3312:x1875694892107776:12345-0@lo:103: 00010000:00010000:1.0:1788802157.421366:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802157.421371:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bbfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbf5 expref: 15 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.421382:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bbfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbf5 expref: 15 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.421410:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.421419:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788802157.421448:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015510613s 00010000:00010000:1.0:1788802157.421453:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.421461:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.421468:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.421475:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.421481:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01680200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802157.421485:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.421492:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.421502:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802157.421524:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802157.421559:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:3312:x1875694892107776:12345-0@lo:103: Request processed in 205us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802157.421566:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788802157.421816:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3383ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892107776:0@lo:103: 00010000:00010000:2.0:1788802157.425592:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bbfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bbf5 expref: 14 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802157.425615:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a688e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875694892107648:0@lo:104: 00010000:00010000:2.0:1788802157.425639:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.425649:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.425655:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802157.425661:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01680200/0x6ecba1490fc9bcab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802157.426336:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:7619:x1875694892107520:12345-0@lo:253: Request processed in 37670us (39446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802157.426348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788802157.426539:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dcb700dc-e7bb-457d-b553-2dc4634087c8:7619:1875694892107520:0@lo:253: 10000000:01000000:0.0:1788802157.426555:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788802157.426560:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788802157.426562:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788802157.426564:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788802157.426565:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788802157.426566:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788802157.426568:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788802157.426569:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788802157.426571:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788802157.426573:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788802157.426574:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788802157.426576:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788802157.426589:0:7619:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788802157.431114:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802157.431634:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788802157.431860:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802157.432015:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788802157.432226:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802157.432941:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788802157.437923:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1788802157.646411:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788802157.697179:0:7619:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788802157.697187:0:7619:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788802157.697221:0:7619:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788802157.697338:0:7619:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788802157.697356:0:7619:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788802157.697372:0:7619:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788802158.676416:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802159.692551:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802160.716724:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802161.741968:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802162.061364:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788802162.061406:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892107904:0@lo:13: 00000100:00100000:2.0:1788802162.061528:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802162.061637:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892107904 00000100:00100000:2.0:1788802162.061648:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892107904 00000100:00100000:2.0:1788802162.061728:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788802162.061741:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892107904:12345-0@lo:13: 00002000:00000024:2.0:1788802162.061795:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802162.061854:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892107904:12345-0@lo:13: Request processed in 116us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802162.061863:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788802162.061888:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788802162.061928:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a18c700 x1875694892107904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802162.061952:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892107904:0@lo:13: 00000100:00100000:1.0:1788802162.575795:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892108160:0@lo:400: 00000100:00100000:1.0:1788802162.575914:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802162.575990:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788802162.575997:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892108032:0@lo:400: 00000100:00100000:1.0:1788802162.576035:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802162.576068:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a68b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892108288:0@lo:400: 00000100:00100000:1.0:1788802162.576096:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802162.576115:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788802162.576120:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a68b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892108416:0@lo:400: 00000100:00100000:1.0:1788802162.576142:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802162.576175:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892108160 00000100:00100000:1.0:1788802162.576185:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892108160 00000100:00100000:1.0:1788802162.576274:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892108288 00000100:00100000:1.0:1788802162.576278:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892108288 00000100:00100000:1.0:1788802162.576314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892108416 00000100:00100000:1.0:1788802162.576317:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892108416 00000100:00100000:1.0:1788802162.576336:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788802162.576346:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892108160:12345-0@lo:400: 00000100:00100000:1.0:1788802162.576429:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892108160:12345-0@lo:400: Request processed in 83us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802162.576437:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788802162.576460:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788802162.576467:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892108288:12345-0@lo:400: 00000100:00100000:1.0:1788802162.576499:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892108288:12345-0@lo:400: Request processed in 33us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802162.576505:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788802162.576518:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788802162.576524:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892108416:12345-0@lo:400: 00000100:00100000:1.0:1788802162.576564:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892108416:12345-0@lo:400: Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802162.576571:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788802162.576595:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788802162.576630:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a68b800 x1875694892108416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802162.576647:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a68b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892108416:0@lo:400: 00010000:00080000:1.0:1788802162.576658:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a68b100 x1875694892108288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802162.576666:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a68b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892108288:0@lo:400: 00010000:00080000:1.0:1788802162.576698:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a688a80 x1875694892108160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802162.576706:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892108160:0@lo:400: 00000100:00100000:0.0:1788802162.576945:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892108032 00000100:00100000:0.0:1788802162.576950:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892108032 00000100:00100000:0.0:1788802162.576993:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788802162.577001:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:3314:x1875694892108032:12345-0@lo:400: 00000100:00100000:0.0:1788802162.577056:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:3314:x1875694892108032:12345-0@lo:400: Request processed in 56us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802162.577063:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788802162.577848:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892108032:0@lo:400: 00010000:00010000:3.0:1788802162.766389:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802163.791464:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788802164.620317:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788802164.620325:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d1d17c800 from 30 10000000:01000000:1.0:1788802164.620330:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788802164.620369:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802164.620381:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802164.620392:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802164.620423:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892108544:0@lo:101: 00000100:00100000:1.0:1788802164.620482:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802164.620523:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d063356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802164.625382:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892108544 00000100:00100000:3.0:1788802164.625400:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892108544 00000100:00100000:3.0:1788802164.625464:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788802164.625475:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892108544:12345-0@lo:101: 00010000:00010000:3.0:1788802164.625494:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802164.625514:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216f000/0x6ecba1490fc9bcb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bcb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802164.625559:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216f000/0x6ecba1490fc9bcb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcb2 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802164.625571:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216f000/0x6ecba1490fc9bcb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcb2 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802164.625581:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216f000, rc 0) 00000100:00100000:3.0:1788802164.625666:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892108544:12345-0@lo:101: Request processed in 193us (5183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802164.625673:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788802164.629794:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a68ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892108544:0@lo:101: 00010000:00010000:0.0:1788802164.629822:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802164.629834:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802164.629918:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892108672:0@lo:501: 00000100:00100000:0.0:1788802164.629977:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802164.630038:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b759c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.630089:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892108672 00000100:00100000:2.0:1788802164.630096:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892108672 00000100:00100000:2.0:1788802164.630147:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788802164.630157:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892108672:12345-0@lo:501: 00000100:00100000:2.0:1788802164.630554:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892108672:12345-0@lo:501: Request processed in 398us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.630562:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788802164.630603:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892108672:0@lo:501: 00000100:00100000:2.0:1788802164.630631:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892108800:0@lo:503: 00000100:00100000:2.0:1788802164.630667:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.630694:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d156cdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.630706:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892108800 00000100:00100000:2.0:1788802164.630709:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892108800 00000100:00100000:2.0:1788802164.630733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788802164.630739:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892108800:12345-0@lo:503: 00000100:00100000:2.0:1788802164.631004:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892108800:12345-0@lo:503: Request processed in 265us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.631010:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788802164.631047:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892108800:0@lo:503: 00000100:00100000:2.0:1788802164.631234:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7936:1875694892108928:0@lo:502: 00000100:00100000:2.0:1788802164.631296:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.631316:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892108928 00000100:00100000:2.0:1788802164.631320:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892108928 00000100:00100000:2.0:1788802164.631341:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788802164.631348:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7936:x1875694892108928:12345-0@lo:502: 00000100:00100000:2.0:1788802164.631548:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7936:x1875694892108928:12345-0@lo:502: Request processed in 200us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.631555:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788802164.631596:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d156cd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.631608:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7936:1875694892108928:0@lo:502: 00000100:00100000:2.0:1788802164.631648:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7936:1875694892109056:0@lo:502: 00000100:00100000:2.0:1788802164.631679:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.631698:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892109056 00000100:00100000:2.0:1788802164.631703:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892109056 00000100:00100000:2.0:1788802164.631721:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788802164.631726:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7936:x1875694892109056:12345-0@lo:502: 00000100:00100000:2.0:1788802164.631843:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:7936:x1875694892109056:12345-0@lo:502: Request processed in 115us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.631849:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788802164.631875:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.631887:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7936:1875694892109056:0@lo:502: 00000040:00080000:2.0:1788802164.631912:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788802164.631958:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788802164.631976:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788802164.631984:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.631994:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802164.632003:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788802164.632005:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788802164.632008:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788802164.632031:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.632039:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.632048:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802164.632059:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892109184:0@lo:101: 00000100:00100000:2.0:1788802164.632084:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.632096:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.632114:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892109184 00000100:00100000:2.0:1788802164.632118:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892109184 00000100:00100000:2.0:1788802164.632138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788802164.632143:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892109184:12345-0@lo:101: 00010000:00010000:2.0:1788802164.632151:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802164.632162:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bcc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bcc0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.632182:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bcc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcc0 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.632205:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bcc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcc0 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.632214:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d029d7a00, rc 0) 00000100:00100000:2.0:1788802164.632273:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892109184:12345-0@lo:101: Request processed in 129us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.632279:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788802164.632318:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892109184:0@lo:101: 00010000:00010000:2.0:1788802164.632329:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.632336:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802164.632369:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892109312:0@lo:501: 00000100:00100000:2.0:1788802164.632392:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.632409:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.632419:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892109312 00000100:00100000:2.0:1788802164.632428:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892109312 00000100:00100000:2.0:1788802164.632449:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788802164.632454:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892109312:12345-0@lo:501: 00000100:00100000:2.0:1788802164.632620:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892109312:12345-0@lo:501: Request processed in 164us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.632627:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788802164.632657:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892109312:0@lo:501: 00000100:00100000:2.0:1788802164.632680:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892109440:0@lo:503: 00000100:00100000:2.0:1788802164.632710:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.632723:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.632735:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892109440 00000100:00100000:2.0:1788802164.632738:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892109440 00000100:00100000:2.0:1788802164.632758:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788802164.632763:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892109440:12345-0@lo:503: 00000100:00100000:2.0:1788802164.633015:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892109440:12345-0@lo:503: Request processed in 251us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.633022:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788802164.633057:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892109440:0@lo:503: 00000100:00100000:0.0:1788802164.640576:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7937:1875694892109568:0@lo:502: 00000100:00100000:0.0:1788802164.640656:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802164.640705:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b75cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802164.640758:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892109568 00000100:00100000:3.0:1788802164.640766:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892109568 00000100:00100000:3.0:1788802164.640815:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788802164.640824:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:7937:x1875694892109568:12345-0@lo:502: 00000100:00100000:3.0:1788802164.641070:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:7937:x1875694892109568:12345-0@lo:502: Request processed in 247us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802164.641078:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788802164.641232:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7937:1875694892109568:0@lo:502: 00000020:01000000:0.0:1788802164.641305:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788802164.641313:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802164.641316:0:7937:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788802164.641322:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788802164.641324:0:7937:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788802164.641340:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7937:1875694892109696:0@lo:502: 00000100:00100000:0.0:1788802164.641372:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802164.641396:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b75cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802164.641547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892109696 00000100:00100000:3.0:1788802164.641552:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892109696 00000100:00100000:3.0:1788802164.641614:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788802164.641622:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:7937:x1875694892109696:12345-0@lo:502: 00000100:00100000:3.0:1788802164.641739:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:7937:x1875694892109696:12345-0@lo:502: Request processed in 117us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802164.641746:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788802164.641815:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7937:1875694892109696:0@lo:502: 00000020:01000000:0.0:1788802164.641831:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802164.641835:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802164.641836:0:7937:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788802164.641840:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788802164.647929:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788802164.647965:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788802164.647978:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.647993:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802164.648005:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788802164.648025:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d054ea800 from 30 10000000:01000000:2.0:1788802164.648027:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788802164.648071:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.648080:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.648092:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802164.648117:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892109824:0@lo:101: 00000100:00100000:2.0:1788802164.648184:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.648263:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.648286:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892109824 00000100:00100000:2.0:1788802164.648294:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892109824 00000100:00100000:2.0:1788802164.648338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788802164.648348:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892109824:12345-0@lo:101: 00010000:00010000:2.0:1788802164.648360:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802164.648372:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bcd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bcce expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.648395:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bcd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcce expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.648405:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bcd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcce expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.648414:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d029d6e00, rc 0) 00000100:00100000:2.0:1788802164.648450:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892109824:12345-0@lo:101: Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.648463:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788802164.648506:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892109824:0@lo:101: 00010000:00010000:2.0:1788802164.648519:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.648527:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802164.648570:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892109952:0@lo:501: 00000100:00100000:2.0:1788802164.648595:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.648612:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.648622:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892109952 00000100:00100000:2.0:1788802164.648625:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892109952 00000100:00100000:2.0:1788802164.648641:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788802164.648647:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892109952:12345-0@lo:501: 00000100:00100000:2.0:1788802164.648860:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892109952:12345-0@lo:501: Request processed in 212us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.648867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788802164.648892:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892109952:0@lo:501: 00000100:00100000:2.0:1788802164.648916:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110080:0@lo:503: 00000100:00100000:2.0:1788802164.648949:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.648961:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.648972:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892110080 00000100:00100000:2.0:1788802164.648975:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892110080 00000100:00100000:2.0:1788802164.648990:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788802164.648996:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892110080:12345-0@lo:503: 00000100:00100000:2.0:1788802164.649136:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892110080:12345-0@lo:503: Request processed in 139us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.649143:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788802164.649179:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110080:0@lo:503: 00000100:00100000:2.0:1788802164.649399:0:7938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7938:1875694892110208:0@lo:502: 00000100:00100000:2.0:1788802164.649434:0:7938:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.649452:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892110208 00000100:00100000:2.0:1788802164.649456:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892110208 00000100:00100000:2.0:1788802164.649476:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788802164.649482:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:7938:x1875694892110208:12345-0@lo:502: 00000100:00100000:2.0:1788802164.649623:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:7938:x1875694892110208:12345-0@lo:502: Request processed in 141us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.649629:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788802164.649660:0:7938:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.649674:0:7938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7938:1875694892110208:0@lo:502: 00000100:00100000:2.0:1788802164.649714:0:7938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7938:1875694892110336:0@lo:502: 00000100:00100000:2.0:1788802164.649744:0:7938:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.649760:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892110336 00000100:00100000:2.0:1788802164.649764:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892110336 00000100:00100000:2.0:1788802164.649783:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788802164.649789:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:7938:x1875694892110336:12345-0@lo:502: 00000100:00100000:2.0:1788802164.649903:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:7938:x1875694892110336:12345-0@lo:502: Request processed in 114us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.649910:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788802164.649937:0:7938:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.649954:0:7938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7938:1875694892110336:0@lo:502: 00000040:00080000:2.0:1788802164.649971:0:7938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788802164.650020:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788802164.650034:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788802164.650042:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650052:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802164.650061:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788802164.650064:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff910d054ea800 from 5 10000000:01000000:2.0:1788802164.650067:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788802164.650088:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650096:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650105:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802164.650116:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110464:0@lo:101: 00000100:00100000:2.0:1788802164.650140:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.650153:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.650164:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892110464 00000100:00100000:2.0:1788802164.650167:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892110464 00000100:00100000:2.0:1788802164.650204:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788802164.650212:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892110464:12345-0@lo:101: 00010000:00010000:2.0:1788802164.650219:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802164.650262:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bce3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bcdc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650281:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcdc expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650291:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bce3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcdc expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650298:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d029d6600, rc 0) 00000100:00100000:2.0:1788802164.650329:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892110464:12345-0@lo:101: Request processed in 118us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.650335:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788802164.650364:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110464:0@lo:101: 00010000:00010000:2.0:1788802164.650374:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650382:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802164.650423:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110592:0@lo:256: 00000100:00100000:2.0:1788802164.650453:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.650472:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.650481:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892110592 00000100:00100000:2.0:1788802164.650485:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892110592 00000100:00100000:2.0:1788802164.650505:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788802164.650512:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892110592:12345-0@lo:256: 20000000:01000000:2.0:1788802164.650523:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788802164.650542:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788802164.650548:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788802164.650616:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892110592:12345-0@lo:256: Request processed in 105us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.650623:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788802164.650649:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110592:0@lo:256: 10000000:01000000:2.0:1788802164.650687:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788802164.650693:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650701:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802164.650708:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788802164.650710:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788802164.650712:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788802164.650726:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650733:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650741:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802164.650753:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110720:0@lo:101: 00000100:00100000:2.0:1788802164.650776:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.650788:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.650798:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892110720 00000100:00100000:2.0:1788802164.650801:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892110720 00000100:00100000:2.0:1788802164.650820:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788802164.650833:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892110720:12345-0@lo:101: 00010000:00010000:2.0:1788802164.650839:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802164.650860:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3f95fe00/0x6ecba1490fc9bcf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bcea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650874:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3f95fe00/0x6ecba1490fc9bcf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcea expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650882:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3f95fe00/0x6ecba1490fc9bcf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcea expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650888:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95fe00, rc 0) 00000100:00100000:2.0:1788802164.650914:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892110720:12345-0@lo:101: Request processed in 82us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.650920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788802164.650947:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110720:0@lo:101: 00010000:00010000:2.0:1788802164.650956:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.650963:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802164.651000:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110848:0@lo:501: 00000100:00100000:2.0:1788802164.651020:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.651030:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.651038:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892110848 00000100:00100000:2.0:1788802164.651041:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892110848 00000100:00100000:2.0:1788802164.651055:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788802164.651059:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892110848:12345-0@lo:501: 00000100:00100000:2.0:1788802164.660171:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892110848:12345-0@lo:501: Request processed in 9101us (9140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.660185:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788802164.667545:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110848:0@lo:501: 00000100:00100000:2.0:1788802164.667690:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110976:0@lo:503: 00000100:00100000:2.0:1788802164.667774:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.667824:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788802164.667880:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892110976 00000100:00100000:3.0:1788802164.667897:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892110976 00000100:00100000:3.0:1788802164.667957:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788802164.667968:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892110976:12345-0@lo:503: 00000100:00100000:3.0:1788802164.668513:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892110976:12345-0@lo:503: Request processed in 545us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802164.668523:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788802164.674526:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892110976:0@lo:503: 00000100:00100000:3.0:1788802164.675538:0:7939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3383ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7939:1875694892111104:0@lo:502: 00000100:00100000:3.0:1788802164.675624:0:7939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802164.675666:0:7939:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d126a8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.675713:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892111104 00000100:00100000:2.0:1788802164.675720:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892111104 00000100:00100000:2.0:1788802164.675769:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788802164.675778:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:7939:x1875694892111104:12345-0@lo:502: 00000100:00100000:2.0:1788802164.676114:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:7939:x1875694892111104:12345-0@lo:502: Request processed in 335us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.676122:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788802164.676233:0:7939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3383ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7939:1875694892111104:0@lo:502: 00000020:01000000:3.0:1788802164.676289:0:7939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788802164.676298:0:7939:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788802164.676305:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802164.676308:0:7939:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788802164.676313:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788802164.676317:0:7939:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.157@tcp to nid 0x20000c0a8c99d (192.168.201.157@tcp) 00000020:01000000:3.0:1788802164.676339:0:7939:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788802164.676342:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788802164.676370:0:7939:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff910d3436cd40) 00000020:00000080:3.0:1788802164.676393:0:7939:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788802164.676399:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788802164.676474:0:7939:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788802164.676481:0:7939:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788802164.676488:0:7939:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9bcff 00010000:00080000:3.0:1788802164.676516:0:7939:0:(ldlm_lib.c:102:import_set_conn()) imp ffff910d21bf7800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:3.0:1788802164.676733:0:7939:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788802164.677031:0:7939:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788802164.677043:0:7939:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788802164.677601:0:7939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788802164.677803:0:7939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788802164.677848:0:7939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788802164.677897:0:7939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788802164.684521:0:7940:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802164.684532:0:7940:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788802164.686197:0:7939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788802164.686211:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788802164.686275:0:7939:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788802164.686299:0:7939:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6ecba1490fc9bd06 00000100:00080000:3.0:1788802164.686310:0:7939:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788802164.686321:0:7939:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910d21bf7800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788802164.686358:0:7939:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d3383ad80 x1875694892111232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788802164.686379:0:7939:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788802164.686425:0:7939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802164.686429:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802164.686431:0:7939:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788802164.686434:0:7939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788802164.686438:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802164.686440:0:7939:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788802164.686442:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788802164.686444:0:7939:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788802164.686471:0:7939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33839f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7939:1875694892111360:0@lo:502: 00000100:00100000:3.0:1788802164.686551:0:7939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802164.686587:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892111360 00000100:00100000:3.0:1788802164.686593:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892111360 00000100:00100000:3.0:1788802164.686630:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788802164.686640:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:7939:x1875694892111360:12345-0@lo:502: 00000100:00100000:3.0:1788802164.686871:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:7939:x1875694892111360:12345-0@lo:502: Request processed in 232us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802164.686887:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788802164.686935:0:7939:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d126a8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802164.686956:0:7939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33839f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:7939:1875694892111360:0@lo:502: 00000020:01000000:3.0:1788802164.686980:0:7939:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802164.686985:0:7939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802164.686986:0:7939:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788802164.686990:0:7939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1788802164.687484:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3383ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892111232:0@lo:8: 00000100:00100000:2.0:1788802164.687523:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788802164.687632:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788802164.687653:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788802164.687663:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.687675:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802164.687685:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788802164.687688:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff910d10cbcd40 from 1 10000000:01000000:2.0:1788802164.687691:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788802164.687723:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.687731:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.687740:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802164.687751:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892112000:0@lo:101: 00000100:00100000:2.0:1788802164.687777:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.687791:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.687805:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892111488:0@lo:400: 00000100:00100000:2.0:1788802164.687827:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.687843:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788802164.687848:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892111616:0@lo:400: 00000100:00100000:2.0:1788802164.687864:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.687883:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892112000 00000100:00100000:2.0:1788802164.687888:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892112000 00000100:00100000:2.0:1788802164.687916:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788802164.687922:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892112000:12345-0@lo:101: 00010000:00010000:2.0:1788802164.687931:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802164.687941:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3f95e800/0x6ecba1490fc9bd14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bd0d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.687961:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3f95e800/0x6ecba1490fc9bd14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd0d expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.687970:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3f95e800/0x6ecba1490fc9bd14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd0d expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.687984:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95e800, rc 0) 00000100:00100000:2.0:1788802164.688011:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892112000:12345-0@lo:101: Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802164.688017:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788802164.688048:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892112000:0@lo:101: 00010000:00010000:2.0:1788802164.688060:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.688068:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802164.688106:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892112128:0@lo:501: 00000100:00100000:2.0:1788802164.688128:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.688140:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72780 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.688151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892112128 00000100:00100000:2.0:1788802164.688154:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892112128 00000100:00100000:2.0:1788802164.688172:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788802164.688178:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892112128:12345-0@lo:501: 00000100:00100000:2.0:1788802164.688439:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892112128:12345-0@lo:501: Request processed in 260us (309us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788802164.688446:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788802164.688480:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892112128:0@lo:501: 10000000:01000000:2.0:1788802164.688498:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788802164.688504:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802164.688520:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802164.689175:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892111232 00000100:00100000:3.0:1788802164.689182:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892111232 00000100:00100000:3.0:1788802164.690289:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788802164.690300:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1875694892111232:12345-0@lo:8: 00010000:00080000:3.0:1788802164.690340:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:3.0:1788802164.690377:0:6690:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6ecba1490fc9bd1b 00002000:00100000:3.0:1788802164.690393:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff910d21bf2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788802164.690397:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788802164.690401:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788802164.690530:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788802164.690709:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788802164.690733:0:6690:0:(import.c:65:import_set_state_nolock()) ffff910d21bf1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802164.690808:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875694892111232:12345-0@lo:8: Request processed in 508us (3283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802164.690815:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788802164.690866:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3383ad80 x1875694892111232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788802174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802164.690877:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788802164.690884:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788802164.690897:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788802164.690902:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788802164.690905:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d21bf7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788802164.690916:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788802164.690920:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3383ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892111232:0@lo:8: 00000004:00080000:3.0:1788802164.690951:0:7940:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788802164.691046:0:7940:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 217637806759ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788802164.692171:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892111744:0@lo:400: 00000100:00100000:0.0:1788802164.692321:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892111488 00000100:00100000:0.0:1788802164.692331:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892111488 00000100:00100000:0.0:1788802164.692379:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892111616 00000100:00100000:0.0:1788802164.692382:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892111616 00000100:00100000:0.0:1788802164.692410:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788802164.692418:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892111488:12345-0@lo:400: 00000100:00100000:0.0:1788802164.692473:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892111488:12345-0@lo:400: Request processed in 57us (4644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802164.692480:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788802164.692496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788802164.692502:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892111616:12345-0@lo:400: 00000100:00100000:0.0:1788802164.692543:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892111616:12345-0@lo:400: Request processed in 41us (4678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802164.692549:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788802164.692570:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892111872:0@lo:400: 00000100:00100000:0.0:1788802164.692601:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802164.692636:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892111872 00000100:00100000:0.0:1788802164.692640:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892111872 00000100:00100000:0.0:1788802164.692658:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788802164.692663:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892111872:12345-0@lo:400: 00000100:00100000:0.0:1788802164.692692:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892111872:12345-0@lo:400: Request processed in 29us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802164.692697:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788802164.692994:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a18c000 x1875694892111872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802164.693008:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892111872:0@lo:400: 00010000:00080000:2.0:1788802164.694209:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a18fb80 x1875694892111616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802164.694225:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892111616:0@lo:400: 00010000:00080000:2.0:1788802164.694260:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a18ed80 x1875694892111488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802164.694269:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892111488:0@lo:400: 00000100:00100000:1.0:1788802164.694366:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802164.694438:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892111744 00000100:00100000:1.0:1788802164.694443:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892111744 00000100:00100000:1.0:1788802164.694488:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788802164.694497:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892111744:12345-0@lo:400: 00000100:00100000:1.0:1788802164.694552:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892111744:12345-0@lo:400: Request processed in 56us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802164.694558:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788802164.694879:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788802164.694884:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788802164.694905:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a18df80 x1875694892111744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802164.694914:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892111744:0@lo:400: 00000004:00080000:0.0:1788802164.790725:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788802164.819467:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788802164.878829:0:7941:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788802164.878862:0:7941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1875694892112384:0@lo:7: 00000100:00100000:0.0:1788802164.878947:0:7941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802164.878989:0:7941:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b75780 going to sleep for 11 seconds 00000100:00100000:0.0:1788802164.879015:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892112256:0@lo:13: 00000100:00100000:0.0:1788802164.879036:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802164.879067:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892112256 00000100:00100000:0.0:1788802164.879074:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892112256 00000100:00100000:0.0:1788802164.879123:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788802164.879140:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892112256:12345-0@lo:13: 00002000:00000024:0.0:1788802164.879169:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788802164.879220:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892112256:12345-0@lo:13: Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802164.879226:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788802164.879286:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3ea00 x1875694892112256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802164.879304:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892112256:0@lo:13: 00000100:00100000:1.0:1788802164.880344:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892112384 00000100:00100000:1.0:1788802164.880355:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892112384 00000100:00100000:1.0:1788802164.880408:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788802164.880416:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7941:x1875694892112384:12345-0@lo:7: 00000100:00080000:0.0:1788802164.883083:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1788802164.896857:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788802164.896868:0:6688:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788802164.896992:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7941:x1875694892112384:12345-0@lo:7: Request processed in 16572us (18039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802164.897004:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788802164.898276:0:7941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3df80 x1875694892112384/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788802180 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802164.898296:0:7941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1875694892112384:0@lo:7: 00000004:00080000:0.0:1788802164.898312:0:7941:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788802164.898355:0:7941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1875694892112512:0@lo:5: 00000100:00100000:0.0:1788802164.898402:0:7941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802164.898448:0:7941:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b75780 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.898480:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892112512 00000100:00100000:2.0:1788802164.898487:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892112512 00000100:00100000:2.0:1788802164.898544:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802164.898555:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7941:x1875694892112512:12345-0@lo:5: 00002000:00080000:2.0:1788802164.898581:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788802164.898585:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788802164.898896:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7941:x1875694892112512:12345-0@lo:5: Request processed in 342us (492us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788802164.898903:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788802164.898986:0:7941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3df80 x1875694892112512/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788802180 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802164.898999:0:7941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1875694892112512:0@lo:5: 00000004:00080000:0.0:1788802164.899009:0:7941:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788802164.899038:0:7941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1875694892112640:0@lo:700: 00000100:00100000:0.0:1788802164.899064:0:7941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802164.899090:0:7941:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b75780 going to sleep for 11 seconds 00000100:00100000:2.0:1788802164.899612:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892112640 00000100:00100000:2.0:1788802164.899618:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892112640 00000100:00100000:2.0:1788802164.899784:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788802164.899792:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7941:x1875694892112640:12345-0@lo:700: 00000100:00100000:2.0:1788802164.899825:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1875694892112768:0@lo:700: 00000100:00100000:2.0:1788802164.899860:0:6696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802164.899895:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72300 going to sleep for 11 seconds 00000100:00100000:3.0:1788802164.901668:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892112768 00000100:00100000:3.0:1788802164.901682:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892112768 00000100:00100000:3.0:1788802164.901744:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788802164.901754:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1875694892112768:12345-0@lo:700: 40000000:02000000:3.0:1788802165.010056:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788802165.032636:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1875694892112768:12345-0@lo:700: Request processed in 130874us (132766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802165.032652:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788802165.032758:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a18ed80 x1875694892112768/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788802180 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802165.032774:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1875694892112768:0@lo:700: 40000000:02000000:2.0:1788802165.032788:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1788802165.207747:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7941:x1875694892112640:12345-0@lo:700: Request processed in 307947us (308672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802165.207763:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1788802165.207808:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788802165.207819:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1788802165.207860:0:7941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3f480 x1875694892112640/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788802180 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802165.208053:0:7941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1875694892112640:0@lo:700: 00000004:02000040:3.0:1788802165.277704:0:7941:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788802165.295598:0:7941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1875694892112896:0@lo:5: 00000100:00100000:0.0:1788802165.295690:0:7941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802165.295737:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892112896 00000100:00100000:0.0:1788802165.295744:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892112896 00000100:00100000:0.0:1788802165.295801:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788802165.295811:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7941:x1875694892112896:12345-0@lo:5: 00000001:02000400:2.0:1788802165.297337:0:7982:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788802165.300318:0:7941:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b75a80 going to sleep for 11 seconds 00002000:00080000:0.0:1788802165.307417:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788802165.307439:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788802165.317660:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7941:x1875694892112896:12345-0@lo:5: Request processed in 21842us (21962us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788802165.317674:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788802165.319017:0:7941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3ca80 x1875694892112896/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788802181 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802165.319032:0:7941:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788802165.319048:0:7941:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff910d10d3ca80 x1875694892112896/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788802181 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802165.319059:0:7941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1875694892112896:0@lo:5: 00000004:00080000:1.0:1788802165.319073:0:7941:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788802165.836424:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802166.863052:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802167.183013:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a68b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892113024:0@lo:13: 00000100:00100000:0.0:1788802167.183090:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802167.183218:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892113024 00000100:00100000:2.0:1788802167.183227:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892113024 00000100:00100000:2.0:1788802167.183311:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802167.183320:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892113024:12345-0@lo:13: 00000100:00080000:0.0:1788802167.183445:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788802167.183480:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802167.183538:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892113024:12345-0@lo:13: Request processed in 219us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802167.183546:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788802167.183615:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a68b100 x1875694892113024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802167.183634:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a68b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892113024:0@lo:13: 00010000:00010000:3.0:1788802167.884477:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802168.917576:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802169.740673:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892113408:0@lo:400: 00000100:00100000:0.0:1788802169.740746:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802169.740812:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788802169.740818:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892113536:0@lo:400: 00000100:00100000:0.0:1788802169.740844:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802169.740880:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892113408 00000100:00100000:0.0:1788802169.740889:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892113408 00000100:00100000:0.0:1788802169.740943:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788802169.740953:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892113408:12345-0@lo:400: 00000100:00100000:0.0:1788802169.741184:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892113408:12345-0@lo:400: Request processed in 232us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802169.741192:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788802169.741217:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892113536 00000100:00100000:0.0:1788802169.741229:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892113536 00000100:00100000:0.0:1788802169.741294:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788802169.741301:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892113536:12345-0@lo:400: 00000100:00100000:1.0:1788802169.741586:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892113152:0@lo:400: 00000100:00100000:1.0:1788802169.741625:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802169.741650:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892113664:0@lo:400: 00000100:00100000:1.0:1788802169.741671:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802169.741690:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788802169.741696:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892113280:0@lo:400: 00000100:00100000:1.0:1788802169.741717:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802169.741734:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892113792:0@lo:400: 00000100:00100000:1.0:1788802169.741754:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802169.741779:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892113664 00000100:00100000:1.0:1788802169.741784:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892113664 00000100:00100000:1.0:1788802169.741804:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892113280 00000100:00100000:1.0:1788802169.741815:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892113280 00000100:00100000:1.0:1788802169.741835:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788802169.741840:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892113664:12345-0@lo:400: 00000100:00100000:1.0:1788802169.741877:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892113664:12345-0@lo:400: Request processed in 37us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802169.741883:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788802169.741899:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788802169.741905:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892113280:12345-0@lo:400: 00000100:00100000:1.0:1788802169.741929:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892113280:12345-0@lo:400: Request processed in 25us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802169.741934:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788802169.741952:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788802169.741960:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788802169.742229:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892113536:12345-0@lo:400: Request processed in 34us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802169.742256:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788802169.742270:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892113792 00000100:00100000:0.0:1788802169.742274:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892113792 00000100:00100000:0.0:1788802169.742296:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788802169.742302:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892113792:12345-0@lo:400: 00000100:00100000:0.0:1788802169.742334:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892113792:12345-0@lo:400: Request processed in 33us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802169.742534:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892113152 00000100:00100000:2.0:1788802169.742539:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892113152 00000100:00100000:2.0:1788802169.742567:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788802169.742573:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892113152:12345-0@lo:400: 00000100:00100000:2.0:1788802169.742607:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892113152:12345-0@lo:400: Request processed in 34us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802169.742612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1788802169.743270:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a6ae680 x1875694892113280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802169.743285:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892113280:0@lo:400: 00010000:00080000:1.0:1788802169.743295:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a6adf80 x1875694892113792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802169.743304:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892113792:0@lo:400: 00000100:00100000:1.0:1788802169.743312:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892113152:0@lo:400: 00010000:00080000:1.0:1788802169.743322:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a6ace00 x1875694892113664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802169.743329:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892113664:0@lo:400: 00000100:00100000:0.0:1788802169.743670:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788802169.743699:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788802169.743704:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788802169.743707:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788802169.743740:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a6ac000 x1875694892113536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802169.743751:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892113536:0@lo:400: 00010000:00080000:0.0:1788802169.743761:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a6ac700 x1875694892113408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802169.743767:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892113408:0@lo:400: 00010000:00010000:1.0:1788802169.932859:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802170.253888:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892113920:0@lo:13: 00000100:00100000:2.0:1788802170.253970:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802170.254407:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892113920 00000100:00100000:2.0:1788802170.254417:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892113920 00000100:00100000:2.0:1788802170.254468:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788802170.254479:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892113920:12345-0@lo:13: 00002000:00000024:2.0:1788802170.254525:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802170.254573:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892113920:12345-0@lo:13: Request processed in 96us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802170.254580:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788802170.254624:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a18ed80 x1875694892113920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802170.254642:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892113920:0@lo:13: 00000001:00080000:3.0:1788802170.412061:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788802170.959544:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802171.862109:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802171.862293:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872166528 00000100:00100000:3.0:1788802171.862306:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872166528 00000100:00100000:3.0:1788802171.862354:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:3.0:1788802171.862365:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2356:x1875694872166528:12345-192.168.201.57@tcp:250: 00010000:00080000:3.0:1788802171.862401:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f34e9515-dc55-4812-97ce-617e4dd802db@192.168.201.57@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1788802171.862441:0:5834:0:(genops.c:1384:class_connect()) connect: client f34e9515-dc55-4812-97ce-617e4dd802db, cookie 0x6ecba1490fc9bd22 00000100:00080000:3.0:1788802171.862752:0:5834:0:(import.c:65:import_set_state_nolock()) ffff910d21bf5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802171.862859:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+5:2356:x1875694872166528:12345-192.168.201.57@tcp:250: Request processed in 493us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802171.862868:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:1.0:1788802171.877814:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802171.879297:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872166656 00000100:00100000:3.0:1788802171.879317:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872166656 00000100:00100000:3.0:1788802171.879392:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:3.0:1788802171.879405:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+5:5587:x1875694872166656:12345-192.168.201.57@tcp:101: 00010000:00010000:3.0:1788802171.879427:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802171.879451:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216f200/0x6ecba1490fc9bd29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edeb3d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802171.879489:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216f200/0x6ecba1490fc9bd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb3d expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802171.879501:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216f200/0x6ecba1490fc9bd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb3d expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802171.879512:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216f200, rc 0) 00000100:00100000:1.0:1788802171.879836:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+6:5587:x1875694872166656:12345-192.168.201.57@tcp:101: Request processed in 431us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802171.879846:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:2.0:1788802171.882443:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802171.883373:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872166784 00000100:00100000:1.0:1788802171.883388:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872166784 00000100:00100000:1.0:1788802171.883446:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:1.0:1788802171.883458:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+6:5587:x1875694872166784:12345-192.168.201.57@tcp:501: 00000100:00100000:1.0:1788802171.884467:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+6:5587:x1875694872166784:12345-192.168.201.57@tcp:501: Request processed in 1005us (2030us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788802171.884480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:2.0:1788802171.889842:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802171.889938:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872166912 00000100:00100000:3.0:1788802171.889953:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872166912 00000100:00100000:3.0:1788802171.890023:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 116 00000100:00100000:3.0:1788802171.890046:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+6:5587:x1875694872166912:12345-192.168.201.57@tcp:101: 00010000:00010000:3.0:1788802171.890080:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802171.890102:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bd30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edeb44 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802171.890466:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bd30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb44 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802171.890483:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bd30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb44 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802171.890495:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216e000, rc 0) 00000100:00100000:2.0:1788802171.890634:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+7:5587:x1875694872166912:12345-192.168.201.57@tcp:101: Request processed in 590us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802171.890643:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 116 00000100:00100000:3.0:1788802171.893531:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802171.899810:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872167040 00000100:00100000:2.0:1788802171.899835:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872167040 00000100:00100000:2.0:1788802171.899933:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:2.0:1788802171.899946:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+7:5587:x1875694872167040:12345-192.168.201.57@tcp:501: 00000100:00100000:2.0:1788802171.900697:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+8:5587:x1875694872167040:12345-192.168.201.57@tcp:501: Request processed in 748us (7175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802171.900707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:2.0:1788802171.904493:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802171.904540:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872167168 00000100:00100000:2.0:1788802171.904691:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872167168 00000100:00100000:2.0:1788802171.904759:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:2.0:1788802171.904772:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+8:5587:x1875694872167168:12345-192.168.201.57@tcp:503: 00000100:00100000:2.0:1788802171.905119:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+8:5587:x1875694872167168:12345-192.168.201.57@tcp:503: Request processed in 348us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802171.905137:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:0.0:1788802171.910506:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802171.910668:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872167296 00000100:00100000:1.0:1788802171.910682:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872167296 00000100:00100000:1.0:1788802171.910754:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:1.0:1788802171.910767:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+8:5606:x1875694872167296:12345-192.168.201.57@tcp:502: 00000100:00100000:1.0:1788802171.911112:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+8:5606:x1875694872167296:12345-192.168.201.57@tcp:502: Request processed in 347us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802171.911121:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:2.0:1788802171.948790:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802171.948934:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872167424 00000100:00100000:3.0:1788802171.948950:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872167424 00000100:00100000:3.0:1788802171.949026:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:3.0:1788802171.949039:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+8:5606:x1875694872167424:12345-192.168.201.57@tcp:502: 00000100:00100000:3.0:1788802171.950004:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+8:5606:x1875694872167424:12345-192.168.201.57@tcp:502: Request processed in 959us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802171.950016:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:3.0:1788802171.960577:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802171.960850:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872167552 00000100:00100000:2.0:1788802171.960865:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872167552 00000100:00100000:2.0:1788802171.960945:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 121 00000100:00100000:2.0:1788802171.960958:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+8:5587:x1875694872167552:12345-192.168.201.57@tcp:101: 00010000:00010000:2.0:1788802171.960982:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802171.961007:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3f95e200/0x6ecba1490fc9bd37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edeb6e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802171.961045:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3f95e200/0x6ecba1490fc9bd37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb6e expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802171.961069:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3f95e200/0x6ecba1490fc9bd37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb6e expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802171.961081:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95e200, rc 0) 00000100:00100000:2.0:1788802171.961183:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+9:5587:x1875694872167552:12345-192.168.201.57@tcp:101: Request processed in 227us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802171.961191:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 121 00010000:00010000:3.0:1788802171.981391:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802172.008749:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802172.010035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872167680 00000100:00100000:0.0:1788802172.010054:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872167680 00000100:00100000:0.0:1788802172.010140:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:0.0:1788802172.010176:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+9:5587:x1875694872167680:12345-192.168.201.57@tcp:256: 20000000:01000000:0.0:1788802172.010211:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788802172.010234:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788802172.010321:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788802172.010326:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788802172.010328:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788802172.014203:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+9:5587:x1875694872167680:12345-192.168.201.57@tcp:256: Request processed in 4019us (5457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802172.014221:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:3.0:1788802172.023953:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802172.024012:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872167808 00000100:00100000:3.0:1788802172.024026:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872167808 00000100:00100000:3.0:1788802172.024098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:3.0:1788802172.024110:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+9:5587:x1875694872167808:12345-192.168.201.57@tcp:101: 00010000:00010000:3.0:1788802172.024465:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802172.024493:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216ea00/0x6ecba1490fc9bd3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edeb75 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802172.024530:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216ea00/0x6ecba1490fc9bd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb75 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802172.024579:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216ea00/0x6ecba1490fc9bd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb75 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802172.024590:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216ea00, rc 0) 00000100:00100000:3.0:1788802172.024660:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:5587:x1875694872167808:12345-192.168.201.57@tcp:101: Request processed in 552us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802172.024667:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:3.0:1788802172.031967:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802172.039709:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872167936 00000100:00100000:0.0:1788802172.039799:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872167936 00000100:00100000:0.0:1788802172.039884:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:0.0:1788802172.039897:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:5587:x1875694872167936:12345-192.168.201.57@tcp:501: 00000100:00100000:0.0:1788802172.040880:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:5587:x1875694872167936:12345-192.168.201.57@tcp:501: Request processed in 978us (8919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802172.040890:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:0.0:1788802172.043666:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802172.043828:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872168064 00000100:00100000:1.0:1788802172.043841:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872168064 00000100:00100000:1.0:1788802172.043908:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00100000:1.0:1788802172.043921:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:5587:x1875694872168064:12345-192.168.201.57@tcp:503: 00000100:00100000:1.0:1788802172.044391:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:5587:x1875694872168064:12345-192.168.201.57@tcp:503: Request processed in 471us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802172.044412:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00100000:2.0:1788802172.056950:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802172.057712:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872168192 00000100:00100000:0.0:1788802172.057727:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872168192 00000100:00100000:0.0:1788802172.057804:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 126 00000100:00100000:0.0:1788802172.057818:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:5613:x1875694872168192:12345-192.168.201.57@tcp:502: 00000100:00100000:0.0:1788802172.058187:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:5613:x1875694872168192:12345-192.168.201.57@tcp:502: Request processed in 371us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802172.058195:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 126 00000100:00100000:2.0:1788802172.071101:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802172.071273:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872168320 00000100:00100000:3.0:1788802172.071287:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872168320 00000100:00100000:3.0:1788802172.071363:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 127 00000100:00100000:3.0:1788802172.071375:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:5613:x1875694872168320:12345-192.168.201.57@tcp:502: 00000100:00100000:3.0:1788802172.071813:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:5613:x1875694872168320:12345-192.168.201.57@tcp:502: Request processed in 439us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802172.071823:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 127 00000100:00100000:0.0:1788802172.075142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802172.075371:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872168448 00000100:00100000:1.0:1788802172.075386:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872168448 00000100:00100000:1.0:1788802172.075446:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:1.0:1788802172.075459:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1875694872168448:12345-192.168.201.57@tcp:38: 00010000:00080000:1.0:1788802172.075503:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:1.0:1788802172.075572:0:5842:0:(genops.c:1384:class_connect()) connect: client df790e2a-6b5b-4b00-92e8-29e1cf7bde69, cookie 0x6ecba1490fc9bd45 00000004:00100000:1.0:1788802172.075614:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788802172.075623:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788802172.156618:0:5842:0:(import.c:65:import_set_state_nolock()) ffff910d21bf0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802172.156738:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2356:x1875694872168448:12345-192.168.201.57@tcp:38: Request processed in 81278us (81613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802172.156757:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:3.0:1788802172.302350:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788802172.302388:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892114048:0@lo:13: 00000100:00100000:3.0:1788802172.302485:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802172.302724:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892114048 00000100:00100000:0.0:1788802172.302735:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892114048 00000100:00100000:0.0:1788802172.302808:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788802172.302819:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892114048:12345-0@lo:13: 00002000:00000024:0.0:1788802172.302864:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802172.302936:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892114048:12345-0@lo:13: Request processed in 119us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802172.302943:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788802172.303041:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a688380 x1875694892114048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802172.303072:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892114048:0@lo:13: 00000100:00080000:1.0:1788802172.303381:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788802173.007748:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802173.165111:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802173.165169:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802173.165476:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872168704 00000100:00100000:0.0:1788802173.165492:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872168704 00000100:00100000:0.0:1788802173.165605:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872168576 00000100:00100000:0.0:1788802173.165609:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872168576 00000100:00100000:0.0:1788802173.165628:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:0.0:1788802173.165640:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:5587:x1875694872168704:12345-192.168.201.57@tcp:41: 00000004:00000024:0.0:1788802173.165698:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788802173.165783:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:5587:x1875694872168704:12345-192.168.201.57@tcp:41: Request processed in 145us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802173.165791:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:0.0:1788802173.165808:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:0.0:1788802173.165815:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:0:x1875694872168576:12345-192.168.201.57@tcp:41: 00000004:00000024:0.0:1788802173.165825:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788802173.165842:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:0:x1875694872168576:12345-192.168.201.57@tcp:41: Request processed in 28us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802173.165847:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00080000:2.0:1788802173.167002:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802173.168891:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802173.169225:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872168832 00000100:00100000:0.0:1788802173.169267:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872168832 00000100:00100000:0.0:1788802173.169375:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:0.0:1788802173.169385:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:5587:x1875694872168832:12345-192.168.201.57@tcp:40: 00000100:00100000:0.0:1788802173.169492:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:5587:x1875694872168832:12345-192.168.201.57@tcp:40: Request processed in 108us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802173.169500:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:0.0:1788802173.171724:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802173.171871:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802173.172066:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802173.172116:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872168960 00000100:00100000:2.0:1788802173.172129:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872168960 00000100:00100000:2.0:1788802173.172187:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872169088 00000100:00100000:2.0:1788802173.172191:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872169088 00000100:00100000:0.0:1788802173.172207:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802173.172312:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:1.0:1788802173.172341:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872169216 00000100:00100000:1.0:1788802173.172345:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872169216 00000100:00100000:2.0:1788802173.172371:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788802173.172373:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875694872168960:12345-192.168.201.57@tcp:8: 00000100:00100000:2.0:1788802173.172375:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1875694872169088:12345-192.168.201.57@tcp:8: 00010000:00080000:2.0:1788802173.172418:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp t0 exp 0000000000000000 cur 226 last 0 00000100:00100000:1.0:1788802173.172425:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:1.0:1788802173.172432:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:5587:x1875694872169216:12345-192.168.201.57@tcp:33: 00000020:00000080:2.0:1788802173.172459:0:6690:0:(genops.c:1384:class_connect()) connect: client df790e2a-6b5b-4b00-92e8-29e1cf7bde69, cookie 0x6ecba1490fc9bd4c 00002000:00100000:2.0:1788802173.172472:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df790e2a-6b5b-4b00-92e8-29e1cf7bde69/ffff910d12daf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788802173.172609:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788802173.172625:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872169344 00000100:00100000:1.0:1788802173.172629:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872169344 00000100:00100000:1.0:1788802173.172658:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 128 00000100:00100000:1.0:1788802173.172664:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872169344:12345-192.168.201.57@tcp:400: 00000100:00100000:1.0:1788802173.172735:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872169344:12345-192.168.201.57@tcp:400: Request processed in 71us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802173.172742:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 128 00002000:00080000:2.0:1788802173.173070:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788802173.173110:0:6690:0:(import.c:65:import_set_state_nolock()) ffff910d12dae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788802173.173148:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2356:x1875694872169088:12345-192.168.201.57@tcp:8: Request processed in 771us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802173.173156:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00010000:00080000:3.0:1788802173.173700:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1788802173.173730:0:6687:0:(genops.c:1384:class_connect()) connect: client df790e2a-6b5b-4b00-92e8-29e1cf7bde69, cookie 0x6ecba1490fc9bd53 00002000:00100000:3.0:1788802173.173741:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df790e2a-6b5b-4b00-92e8-29e1cf7bde69/ffff910d3efbf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788802173.173750:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788802173.174356:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788802173.174385:0:6687:0:(import.c:65:import_set_state_nolock()) ffff910d3efb9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802173.174439:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2356:x1875694872168960:12345-192.168.201.57@tcp:8: Request processed in 2066us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802173.174449:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000004:00080000:3.0:1788802173.184154:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 11642us 00000004:00200000:0.0:1788802173.196946:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788802173.197125:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:5587:x1875694872169216:12345-192.168.201.57@tcp:33: Request processed in 24682us (25048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802173.197151:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:2.0:1788802173.320363:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802173.320464:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872169472 00000100:00100000:1.0:1788802173.320479:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872169472 00000100:00100000:3.0:1788802173.320771:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:3.0:1788802173.320790:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:5630:x1875694872169472:12345-192.168.201.57@tcp:101: 00010000:00010000:3.0:1788802173.320823:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802173.323019:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9bd5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeb9f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802173.323879:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bd61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802173.323903:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bd61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802173.323919:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bd61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802173.323989:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788802173.323994:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802173.324018:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bd61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802173.324058:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9bd5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb9f expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802173.324083:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bd61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb9f expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802173.324401:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02e21900) 00010000:00010000:2.0:1788802173.324406:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802173.324412:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95e000, rc 0) 00000100:00100000:2.0:1788802173.324506:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:5630:x1875694872169472:12345-192.168.201.57@tcp:101: Request processed in 3722us (4168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802173.324516:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00010000:00010000:3.0:1788802174.028656:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802174.861794:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892114560:0@lo:400: 00000100:00100000:2.0:1788802174.861918:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802174.862091:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892114176:0@lo:400: 00000100:00100000:3.0:1788802174.862165:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892114432:0@lo:400: 00000100:00100000:0.0:1788802174.862235:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892114304:0@lo:400: 00000100:00100000:1.0:1788802174.863804:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802174.864274:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892114688:0@lo:400: 00000100:00100000:1.0:1788802174.864328:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802174.864398:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892114176 00000100:00100000:1.0:1788802174.864409:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892114176 00000100:00100000:1.0:1788802174.864468:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788802174.864478:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892114176:12345-0@lo:400: 00000100:00100000:1.0:1788802174.864541:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892114176:12345-0@lo:400: Request processed in 64us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802174.864621:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788802174.864690:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892114176:0@lo:400: 00000100:00100000:1.0:1788802174.864816:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892114688 00000100:00100000:1.0:1788802174.864821:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892114688 00000100:00100000:1.0:1788802174.865153:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788802174.865161:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892114688:12345-0@lo:400: 00000100:00100000:1.0:1788802174.865213:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892114688:12345-0@lo:400: Request processed in 52us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802174.865219:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788802174.865267:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802174.865300:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892114688:0@lo:400: 00000100:00100000:1.0:1788802174.865339:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892114560 00000100:00100000:1.0:1788802174.865344:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892114560 00000100:00100000:1.0:1788802174.865382:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788802174.865389:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892114560:12345-0@lo:400: 00000100:00100000:1.0:1788802174.865428:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892114560:12345-0@lo:400: Request processed in 40us (3511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802174.865458:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788802174.865478:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802174.867865:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802174.868038:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892114432 00000100:00100000:3.0:1788802174.868055:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892114432 00000100:00100000:3.0:1788802174.868139:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788802174.868150:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892114432:12345-0@lo:400: 00000100:00100000:3.0:1788802174.868276:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892114432:12345-0@lo:400: Request processed in 129us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802174.868285:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788802174.868310:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802174.868357:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892114432:0@lo:400: 00000100:00100000:0.0:1788802174.876201:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802174.876299:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892114816:0@lo:400: 00000100:00100000:0.0:1788802174.876356:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802174.876499:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892114304 00000100:00100000:1.0:1788802174.876511:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892114304 00000100:00100000:1.0:1788802174.876597:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788802174.876608:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892114304:12345-0@lo:400: 00000100:00100000:1.0:1788802174.876680:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892114304:12345-0@lo:400: Request processed in 73us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802174.876687:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788802174.877139:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892114304:0@lo:400: 00010000:00080000:2.0:1788802174.877282:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad5880 x1875694892114560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802174.877294:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892114560:0@lo:400: 00000100:00100000:3.0:1788802174.877564:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892114816 00000100:00100000:3.0:1788802174.877570:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892114816 00000100:00100000:3.0:1788802174.877634:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788802174.877643:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892114816:12345-0@lo:400: 00000100:00100000:3.0:1788802174.877709:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892114816:12345-0@lo:400: Request processed in 67us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802174.877715:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788802174.878137:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad5c00 x1875694892114816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802174.878148:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788802174.878162:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892114816:0@lo:400: 00000100:00080000:1.0:1788802174.878306:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788802175.052458:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802175.211191:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802175.212661:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872169600 00000100:00100000:3.0:1788802175.212681:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872169600 00000100:00100000:3.0:1788802175.212804:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788802175.212817:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:5682:x1875694872169600:12345-192.168.201.57@tcp:41: 00000004:00000024:3.0:1788802175.212877:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788802175.212992:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:5682:x1875694872169600:12345-192.168.201.57@tcp:41: Request processed in 178us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802175.213000:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00080000:1.0:1788802175.213230:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802175.218804:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802175.218959:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872169728 00000100:00100000:0.0:1788802175.218976:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872169728 00000100:00100000:0.0:1788802175.219096:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:0.0:1788802175.219110:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:5682:x1875694872169728:12345-192.168.201.57@tcp:13: 00002000:00000024:0.0:1788802175.219168:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802175.219309:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:5682:x1875694872169728:12345-192.168.201.57@tcp:13: Request processed in 202us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802175.219318:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00080000:1.0:1788802175.220052:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802175.222050:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802175.222382:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872169856 00000100:00100000:0.0:1788802175.222396:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872169856 00000100:00100000:0.0:1788802175.222487:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:0.0:1788802175.222499:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:5682:x1875694872169856:12345-192.168.201.57@tcp:13: 00002000:00000024:0.0:1788802175.222556:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802175.222646:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:5682:x1875694872169856:12345-192.168.201.57@tcp:13: Request processed in 150us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802175.222654:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00080000:1.0:1788802175.223662:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788802175.372720:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788802175.372759:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892114944:0@lo:13: 00000100:00100000:0.0:1788802175.372862:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802175.373206:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892114944 00000100:00100000:2.0:1788802175.373221:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892114944 00000100:00100000:2.0:1788802175.373314:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788802175.373327:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892114944:12345-0@lo:13: 00002000:00000024:2.0:1788802175.373356:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802175.373501:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892114944:12345-0@lo:13: Request processed in 176us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802175.373508:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788802175.373741:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad4380 x1875694892114944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802175.373766:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892114944:0@lo:13: 00010000:00010000:1.0:1788802176.079419:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788802176.991629:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00010000:00010000:3.0:1788802177.100468:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802177.432459:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892115072:0@lo:13: 00000100:00100000:1.0:1788802177.432572:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802177.432676:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892115072 00000100:00100000:1.0:1788802177.432688:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892115072 00000100:00100000:1.0:1788802177.432765:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788802177.432777:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892115072:12345-0@lo:13: 00002000:00000024:1.0:1788802177.432834:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802177.432891:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892115072:12345-0@lo:13: Request processed in 116us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802177.432899:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788802177.432926:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788802177.432997:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a689500 x1875694892115072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802177.433021:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892115072:0@lo:13: 00000001:00100000:0.0:1788802177.574320:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000001:00100000:1.0:1788802177.596824:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000001:02000400:2.0:1788802178.060171:0:8290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788802178.129992:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802178.554029:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802178.554149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802178.554188:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802178.554227:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802178.554406:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872170240 00000100:00100000:1.0:1788802178.554418:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872170240 00000100:00100000:1.0:1788802178.554488:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872170368 00000100:00100000:1.0:1788802178.554492:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872170368 00000100:00100000:1.0:1788802178.554518:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:1.0:1788802178.554528:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872170240:12345-192.168.201.57@tcp:400: 00000100:00100000:1.0:1788802178.554610:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872170240:12345-192.168.201.57@tcp:400: Request processed in 83us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802178.554618:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:1.0:1788802178.554635:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:1.0:1788802178.554642:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872170368:12345-192.168.201.57@tcp:400: 00000100:00100000:1.0:1788802178.554683:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872170368:12345-192.168.201.57@tcp:400: Request processed in 41us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802178.554689:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00080000:2.0:1788802178.555137:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802178.555143:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802178.555579:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872170112 00000100:00100000:0.0:1788802178.555586:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872170112 00000100:00100000:0.0:1788802178.555669:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:0.0:1788802178.555679:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872170112:12345-192.168.201.57@tcp:400: 00000100:00100000:0.0:1788802178.555726:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872170112:12345-192.168.201.57@tcp:400: Request processed in 49us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802178.555733:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00080000:2.0:1788802178.555924:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802178.567908:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872169984 00000100:00100000:3.0:1788802178.567924:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872169984 00000100:00100000:3.0:1788802178.568006:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 130 00000100:00100000:3.0:1788802178.568018:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872169984:12345-192.168.201.57@tcp:400: 00000100:00100000:3.0:1788802178.568118:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872169984:12345-192.168.201.57@tcp:400: Request processed in 103us (14101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802178.568127:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 130 00010000:00010000:1.0:1788802179.148557:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802179.985000:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892115200:0@lo:400: 00000100:00100000:1.0:1788802179.985109:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802179.985184:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a68b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892115712:0@lo:400: 00000100:00100000:1.0:1788802179.985216:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802179.985268:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788802179.985274:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892115328:0@lo:400: 00000100:00100000:1.0:1788802179.985299:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802179.985318:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892115840:0@lo:400: 00000100:00100000:1.0:1788802179.985363:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802179.985395:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892115584:0@lo:400: 00000100:00100000:1.0:1788802179.985421:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802179.985452:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788802179.985458:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892115456:0@lo:400: 00000100:00100000:1.0:1788802179.985482:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802179.985515:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892115200 00000100:00100000:1.0:1788802179.985525:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892115200 00000100:00100000:1.0:1788802179.985805:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788802179.985817:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892115200:12345-0@lo:400: 00000100:00100000:1.0:1788802179.985886:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892115200:12345-0@lo:400: Request processed in 72us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802179.985894:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788802179.985943:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892115712 00000100:00100000:1.0:1788802179.985947:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892115712 00000100:00100000:1.0:1788802179.985985:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892115328 00000100:00100000:1.0:1788802179.985988:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892115328 00000100:00100000:1.0:1788802179.986179:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892115456 00000100:00100000:1.0:1788802179.986183:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892115456 00000100:00100000:1.0:1788802179.986203:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788802179.986209:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892115712:12345-0@lo:400: 00000100:00100000:1.0:1788802179.986286:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892115712:12345-0@lo:400: Request processed in 77us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802179.986293:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788802179.986305:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788802179.986313:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892115328:12345-0@lo:400: 00000100:00100000:1.0:1788802179.986340:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892115328:12345-0@lo:400: Request processed in 30us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802179.986355:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788802179.986367:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788802179.986373:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892115456:12345-0@lo:400: 00000100:00100000:1.0:1788802179.986405:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892115456:12345-0@lo:400: Request processed in 33us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802179.986410:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788802179.986434:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892115840 00000100:00100000:1.0:1788802179.986437:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892115840 00000100:00100000:1.0:1788802179.986736:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892115584 00000100:00100000:1.0:1788802179.986741:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892115584 00000100:00100000:1.0:1788802179.986764:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788802179.986771:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892115840:12345-0@lo:400: 00000100:00100000:1.0:1788802179.986808:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892115840:12345-0@lo:400: Request processed in 38us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802179.986814:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788802179.986826:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788802179.986832:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892115584:12345-0@lo:400: 00000100:00100000:1.0:1788802179.987088:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892115584:12345-0@lo:400: Request processed in 255us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802179.987094:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788802179.987194:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788802179.987200:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788802179.987204:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802179.987287:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892115456:0@lo:400: 00010000:00080000:1.0:1788802179.987306:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a688380 x1875694892115584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802179.987335:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892115584:0@lo:400: 00000100:00100000:1.0:1788802179.987387:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892115328:0@lo:400: 00010000:00080000:1.0:1788802179.987400:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a68ad80 x1875694892115840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802179.987408:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892115840:0@lo:400: 00000100:00100000:1.0:1788802179.987420:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892115200:0@lo:400: 00000100:00100000:1.0:1788802179.987430:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a68b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892115712:0@lo:400: 00010000:00010000:3.0:1788802180.172416:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802180.492396:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892115968:0@lo:13: 00000100:00100000:2.0:1788802180.492501:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802180.494700:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892115968 00000100:00100000:1.0:1788802180.494723:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892115968 00000100:00100000:1.0:1788802180.494790:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788802180.494799:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892115968:12345-0@lo:13: 00002000:00000024:1.0:1788802180.494848:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802180.494970:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892115968:12345-0@lo:13: Request processed in 171us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802180.494976:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788802180.495040:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad4700 x1875694892115968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802180.495067:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892115968:0@lo:13: 00010000:00010000:1.0:1788802181.196585:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802182.222001:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788802182.407856:0:8439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa2bccb40 20000000:00000080:3.0:1788802182.407893:0:8439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910d33dcf000 uarg=0000000000000000 20000000:01000000:3.0:1788802182.408188:0:8439:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788802182.408191:0:8439:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788802182.408194:0:8439:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788802182.408200:0:8439:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788802182.408207:0:8439:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788802182.408225:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788802182.408228:0:8439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788802182.408769:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788802182.408774:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788802182.415777:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788802182.416595:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788802182.416681:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788802182.416720:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788802182.416738:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788802182.416742:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788802182.418011:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788802182.418846:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788802182.418917:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788802182.418999:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788802182.419017:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788802182.419020:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788802182.420215:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788802182.422321:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788802182.422416:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788802182.422451:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788802182.422465:0:8439:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788802182.422470:0:8439:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788802182.423828:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788802182.428740:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788802182.428809:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788802182.428844:0:8439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1788802182.428870:0:8439:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788802182.428910:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.428935:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bc65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc5e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.428943:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216fa00/0x6ecba1490fc9bc8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc88 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.428951:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216f000/0x6ecba1490fc9bcb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcb2 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.428958:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bcc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcc0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.428965:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bcd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcce expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.428973:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3f95fe00/0x6ecba1490fc9bcf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bcea expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.428991:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3f95e800/0x6ecba1490fc9bd14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd0d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429024:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216f200/0x6ecba1490fc9bd29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb3d expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429032:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bd30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb44 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429039:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429090:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bd30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb44 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429108:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bd30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb44 expref: 9 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.429127:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116096:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802182.429310:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216f200/0x6ecba1490fc9bd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb3d expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429319:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d4216f200/0x6ecba1490fc9bd29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb3d expref: 9 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.429339:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116224:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802182.429373:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3f95e800/0x6ecba1490fc9bd14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bd0d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429382:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d3f95e800/0x6ecba1490fc9bd14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bd0d expref: 18 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.429404:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116352:0@lo:104: 00000100:00100000:2.0:1788802182.429457:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788802182.429503:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3f95fe00/0x6ecba1490fc9bcf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bcea expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429513:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d3f95fe00/0x6ecba1490fc9bcf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcea expref: 18 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.429521:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116480:0@lo:104: 00000100:00100000:2.0:1788802182.429546:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788802182.429576:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bcd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bcce expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429584:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bcd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcce expref: 18 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.429593:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116608:0@lo:104: 00010000:00010000:2.0:1788802182.429621:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bcc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bcc0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429629:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bcc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcc0 expref: 18 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.429636:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116736:0@lo:104: 00010000:00010000:2.0:1788802182.429661:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216f000/0x6ecba1490fc9bcb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bcb2 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429670:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d4216f000/0x6ecba1490fc9bcb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcb2 expref: 18 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.429685:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116864:0@lo:104: 00010000:00010000:2.0:1788802182.429711:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216fa00/0x6ecba1490fc9bc8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bc88 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429719:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d4216fa00/0x6ecba1490fc9bc8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc88 expref: 18 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.429727:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116992:0@lo:104: 00010000:00010000:2.0:1788802182.429751:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bc65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bc5e expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.429759:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bc65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc5e expref: 18 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.429767:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892117120:0@lo:104: 00000100:00100000:2.0:1788802182.429782:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788802182.429900:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788802182.429921:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.429934:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.429941:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.429949:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.429956:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.429965:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892116352 00000100:00100000:0.0:1788802182.429974:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892116352 00000100:00100000:0.0:1788802182.430019:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892116480 00000100:00100000:0.0:1788802182.430021:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892116480 00000100:00100000:0.0:1788802182.430036:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892116608 00000100:00100000:0.0:1788802182.430039:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892116608 00000100:00100000:0.0:1788802182.430046:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892116736 00000100:00100000:0.0:1788802182.430048:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892116736 00000100:00100000:0.0:1788802182.430055:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892116864 00000100:00100000:0.0:1788802182.430057:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892116864 00000100:00100000:0.0:1788802182.430064:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892116992 00000100:00100000:0.0:1788802182.430066:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892116992 00000100:00100000:0.0:1788802182.430073:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892117120 00000100:00100000:0.0:1788802182.430075:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892117120 00000100:00100000:0.0:1788802182.430086:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788802182.430094:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:8439:x1875694892116352:12345-0@lo:104: 00010000:00010000:0.0:1788802182.430109:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430177:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788802182.430183:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+9:8439:x1875694892116352:12345-0@lo:104: Request processed in 90us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.430190:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788802182.430207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788802182.430212:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee5c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+8:8439:x1875694892116480:12345-0@lo:104: 00010000:00010000:0.0:1788802182.430219:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430269:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788802182.430274:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee5c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+8:8439:x1875694892116480:12345-0@lo:104: Request processed in 62us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.430280:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788802182.430316:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788802182.430322:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+7:8439:x1875694892116608:12345-0@lo:104: 00010000:00010000:0.0:1788802182.430333:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430363:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788802182.430367:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+7:8439:x1875694892116608:12345-0@lo:104: Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.430373:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788802182.430384:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788802182.430389:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+6:8439:x1875694892116736:12345-0@lo:104: 00010000:00010000:0.0:1788802182.430401:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430422:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788802182.430426:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+6:8439:x1875694892116736:12345-0@lo:104: Request processed in 37us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.430431:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788802182.430440:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788802182.430445:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:8439:x1875694892116864:12345-0@lo:104: 00010000:00010000:0.0:1788802182.430451:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430477:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788802182.430482:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:8439:x1875694892116864:12345-0@lo:104: Request processed in 37us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.430488:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788802182.430498:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788802182.430504:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:8439:x1875694892116992:12345-0@lo:104: 00010000:00010000:0.0:1788802182.430517:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430543:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788802182.430548:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:8439:x1875694892116992:12345-0@lo:104: Request processed in 45us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.430554:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788802182.430568:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788802182.430574:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:8439:x1875694892117120:12345-0@lo:104: 00010000:00010000:0.0:1788802182.430582:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430608:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788802182.430612:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:8439:x1875694892117120:12345-0@lo:104: Request processed in 39us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.430618:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788802182.430639:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788802182.430646:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430654:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e600 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802182.430658:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430668:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802182.430676:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802182.430690:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788802182.430728:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430735:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802182.430757:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430764:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3f95e600/0x6ecba1490fc9bd0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bd14 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430780:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788802182.430783:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430788:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d6400 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802182.430791:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430798:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802182.430805:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802182.430810:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788802182.430823:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430829:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802182.430854:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430861:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d029d6400/0x6ecba1490fc9bcea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430871:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788802182.430886:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430893:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d7c00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802182.430896:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430902:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802182.430909:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802182.430914:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788802182.430929:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430935:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802182.430940:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430947:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d029d7c00/0x6ecba1490fc9bcce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430959:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788802182.430968:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430975:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d6000 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802182.430978:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.430985:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802182.430991:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802182.430997:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788802182.431012:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431019:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802182.431025:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431031:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d029d6000/0x6ecba1490fc9bcc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcc7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431040:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788802182.431043:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431049:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681800 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802182.431052:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431069:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802182.431076:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802182.431082:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788802182.431096:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431102:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802182.431108:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431115:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d01681800/0x6ecba1490fc9bcb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431125:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788802182.431128:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431133:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d6200 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802182.431136:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431143:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802182.431149:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802182.431161:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788802182.431191:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431198:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802182.431203:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431210:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d029d6200/0x6ecba1490fc9bc88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc8f expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431218:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802182.431221:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431226:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681a00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802182.431229:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431256:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802182.431264:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802182.431269:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788802182.431281:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431287:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802182.431297:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431304:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bc5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc65 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431320:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802182.431322:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802182.431324:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802182.431334:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802182.431341:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802182.431368:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892117248:0@lo:103: 00000100:00100000:0.0:1788802182.431411:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.431440:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892117760:0@lo:103: 00000100:00100000:0.0:1788802182.431462:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.431485:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788802182.431491:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892117632:0@lo:103: 00000100:00100000:0.0:1788802182.431511:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.431543:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892117376:0@lo:103: 00000100:00100000:0.0:1788802182.431566:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.431581:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892117888:0@lo:103: 00000100:00100000:0.0:1788802182.431599:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.431610:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788802182.431615:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892117504:0@lo:103: 00000100:00100000:0.0:1788802182.431631:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.431640:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892118016:0@lo:103: 00000100:00100000:0.0:1788802182.431662:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802182.431699:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892117248 00000100:00100000:0.0:1788802182.431706:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892117248 00010000:00010000:0.0:1788802182.431734:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3f95e800/0x6ecba1490fc9bd14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bd0d expref: 19 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802182.431756:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892117760 00000100:00100000:0.0:1788802182.431759:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892117760 00010000:00010000:0.0:1788802182.431770:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216f000/0x6ecba1490fc9bcb9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcb2 expref: 20 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802182.431781:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892117632 00000100:00100000:0.0:1788802182.431783:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892117632 00010000:00010000:0.0:1788802182.431794:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bcc7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcc0 expref: 21 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802182.431803:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892117376 00000100:00100000:0.0:1788802182.431805:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892117376 00010000:00010000:0.0:1788802182.431814:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3f95fe00/0x6ecba1490fc9bcf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcea expref: 22 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802182.431823:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892117888 00000100:00100000:0.0:1788802182.431826:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892117888 00010000:00010000:0.0:1788802182.431835:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216fa00/0x6ecba1490fc9bc8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc88 expref: 23 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802182.431843:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892117504 00000100:00100000:0.0:1788802182.431845:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892117504 00010000:00010000:0.0:1788802182.431854:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bcd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcce expref: 24 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802182.431862:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892118016 00000100:00100000:0.0:1788802182.431864:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892118016 00010000:00010000:0.0:1788802182.431872:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bc65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc5e expref: 25 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802182.431908:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788802182.431916:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+25:3314:x1875694892117248:12345-0@lo:103: 00010000:00010000:0.0:1788802182.431929:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802182.431936:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3f95e800/0x6ecba1490fc9bd14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bd0d expref: 25 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431946:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3f95e800/0x6ecba1490fc9bd14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bd0d expref: 25 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.431966:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802182.431998:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+25:3314:x1875694892117248:12345-0@lo:103: Request processed in 83us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.432005:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788802182.432020:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788802182.432026:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+24:3314:x1875694892117760:12345-0@lo:103: 00010000:00010000:0.0:1788802182.432033:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802182.432037:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216f000/0x6ecba1490fc9bcb9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcb2 expref: 24 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432045:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216f000/0x6ecba1490fc9bcb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcb2 expref: 24 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432054:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802182.432074:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+24:3314:x1875694892117760:12345-0@lo:103: Request processed in 49us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.432080:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788802182.432090:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788802182.432101:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+23:3314:x1875694892117632:12345-0@lo:103: 00010000:00010000:0.0:1788802182.432109:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802182.432114:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bcc7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcc0 expref: 23 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432123:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bcc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcc0 expref: 23 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432132:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802182.432151:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+23:3314:x1875694892117632:12345-0@lo:103: Request processed in 50us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.432156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788802182.432168:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788802182.432174:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+22:3311:x1875694892117376:12345-0@lo:103: 00010000:00010000:0.0:1788802182.432181:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802182.432184:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3f95fe00/0x6ecba1490fc9bcf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcea expref: 22 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432192:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3f95fe00/0x6ecba1490fc9bcf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcea expref: 22 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432201:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802182.432227:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+22:3311:x1875694892117376:12345-0@lo:103: Request processed in 53us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.432233:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788802182.432276:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788802182.432282:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+21:3311:x1875694892117888:12345-0@lo:103: 00010000:00010000:0.0:1788802182.432291:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802182.432301:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216fa00/0x6ecba1490fc9bc8f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc88 expref: 21 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432308:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216fa00/0x6ecba1490fc9bc8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc88 expref: 21 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432318:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802182.432340:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+21:3311:x1875694892117888:12345-0@lo:103: Request processed in 59us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.432346:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788802182.432357:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788802182.432363:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+20:3311:x1875694892117504:12345-0@lo:103: 00010000:00010000:0.0:1788802182.432371:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802182.432374:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bcd5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcce expref: 20 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432382:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bcd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bcce expref: 20 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432391:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802182.432412:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+20:3311:x1875694892117504:12345-0@lo:103: Request processed in 49us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.432418:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788802182.432429:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788802182.432434:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892118016:12345-0@lo:103: 00010000:00010000:0.0:1788802182.432442:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802182.432446:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bc65 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc5e expref: 19 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432465:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bc65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc5e expref: 19 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802182.432474:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802182.432495:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892118016:12345-0@lo:103: Request processed in 61us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802182.432502:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788802182.432570:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892117504:0@lo:103: 00000100:00100000:0.0:1788802182.432579:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892118016:0@lo:103: 00000100:00100000:0.0:1788802182.432586:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892117376:0@lo:103: 00000100:00100000:0.0:1788802182.432592:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892117888:0@lo:103: 00000100:00100000:0.0:1788802182.432624:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892117632:0@lo:103: 00000100:00100000:0.0:1788802182.432631:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892117248:0@lo:103: 00000100:00100000:0.0:1788802182.432637:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892117760:0@lo:103: 00010000:00010000:2.0:1788802182.439381:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3f95e800/0x6ecba1490fc9bd14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bd0d expref: 18 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.439411:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116352:0@lo:104: 00010000:00010000:2.0:1788802182.439425:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3f95fe00/0x6ecba1490fc9bcf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bcea expref: 17 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.439433:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116480:0@lo:104: 00010000:00010000:2.0:1788802182.439444:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d029d6e00/0x6ecba1490fc9bcd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bcce expref: 16 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.439455:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116608:0@lo:104: 00010000:00010000:2.0:1788802182.439489:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d029d7a00/0x6ecba1490fc9bcc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bcc0 expref: 15 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.439500:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116736:0@lo:104: 00010000:00010000:2.0:1788802182.439510:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216f000/0x6ecba1490fc9bcb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bcb2 expref: 14 pid: 5834 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.439518:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116864:0@lo:104: 00010000:00010000:2.0:1788802182.439528:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216fa00/0x6ecba1490fc9bc8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bc88 expref: 13 pid: 5837 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.439536:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116992:0@lo:104: 00010000:00010000:2.0:1788802182.439547:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bc65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bc5e expref: 12 pid: 5836 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.439556:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892117120:0@lo:104: 00000100:00100000:2.0:1788802182.444086:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116096:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802182.444107:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8439:1875694892116224:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802182.444160:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802182.457509:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802182.457583:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802182.458849:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872170624 00000100:00100000:3.0:1788802182.458867:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872170624 00010000:00010000:3.0:1788802182.458949:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216f200/0x6ecba1490fc9bd29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb3d expref: 10 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802182.459000:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872170496 00000100:00100000:3.0:1788802182.459004:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872170496 00010000:00010000:3.0:1788802182.459019:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bd30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb44 expref: 11 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802182.459069:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788802182.459081:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f34e9515-dc55-4812-97ce-617e4dd802db+11:2360:x1875694872170624:12345-192.168.201.57@tcp:103: 00010000:00010000:3.0:1788802182.459102:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802182.459110:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216f200/0x6ecba1490fc9bd29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb3d expref: 11 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459122:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216f200/0x6ecba1490fc9bd29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb3d expref: 11 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459147:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216f200/0x6ecba1490fc9bd29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb3d expref: 11 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459169:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802182.459267:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872170624:12345-192.168.201.57@tcp:103: Request processed in 188us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802182.459276:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788802182.459296:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:3.0:1788802182.459303:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f34e9515-dc55-4812-97ce-617e4dd802db+9:2360:x1875694872170496:12345-192.168.201.57@tcp:103: 00010000:00010000:3.0:1788802182.459312:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802182.459317:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bd30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb44 expref: 9 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459329:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bd30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb44 expref: 9 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459340:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9bd30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb44 expref: 9 pid: 5834 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459360:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459371:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459391:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459399:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459406:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459413:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459419:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95fc00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802182.459424:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459432:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459446:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802182.459462:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802182.459484:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f34e9515-dc55-4812-97ce-617e4dd802db+8:2360:x1875694872170496:12345-192.168.201.57@tcp:103: Request processed in 181us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802182.459496:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00010000:00010000:2.0:1788802182.459980:0:8439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.459991:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802182.460010:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9bd68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802182.541832:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892118144:0@lo:13: 00000100:00100000:1.0:1788802182.541946:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802182.542044:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892118144 00000100:00100000:1.0:1788802182.542054:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892118144 00000100:00100000:1.0:1788802182.542131:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788802182.542141:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892118144:12345-0@lo:13: 00002000:00000024:1.0:1788802182.542186:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802182.542235:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892118144:12345-0@lo:13: Request processed in 95us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802182.542266:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788802182.542291:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788802182.543264:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3f480 x1875694892118144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802182.543296:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892118144:0@lo:13: 00010000:00010000:1.0:1788802183.244713:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788802183.566201:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788802183.566213:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d0450e000 from 39 10000000:01000000:2.0:1788802183.566221:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788802183.566321:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.566335:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.566351:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802183.566396:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892118272:0@lo:101: 00000100:00100000:2.0:1788802183.566592:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802183.566680:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553240 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.567471:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892118272 00000100:00100000:1.0:1788802183.567484:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892118272 00000100:00100000:1.0:1788802183.567567:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788802183.567579:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+12:5840:x1875694892118272:12345-0@lo:101: 00010000:00010000:1.0:1788802183.567597:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802183.567616:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01680c00/0x6ecba1490fc9bd76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bd6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.567658:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01680c00/0x6ecba1490fc9bd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd6f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.567670:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01680c00/0x6ecba1490fc9bd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd6f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.567681:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01680c00, rc 0) 00000100:00100000:1.0:1788802183.567753:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892118272:12345-0@lo:101: Request processed in 176us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802183.567783:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788802183.567802:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892118272:0@lo:101: 00010000:00010000:0.0:1788802183.567822:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802183.567833:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802183.567919:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892118400:0@lo:501: 00000100:00100000:0.0:1788802183.567951:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.567997:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.568075:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892118400 00000100:00100000:3.0:1788802183.568080:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892118400 00000100:00100000:3.0:1788802183.568113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788802183.568121:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892118400:12345-0@lo:501: 00000100:00100000:3.0:1788802183.568610:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892118400:12345-0@lo:501: Request processed in 489us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.568618:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788802183.569156:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892118400:0@lo:501: 00000100:00100000:0.0:1788802183.569204:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892118528:0@lo:503: 00000100:00100000:0.0:1788802183.569280:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.569316:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.569353:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892118528 00000100:00100000:1.0:1788802183.569359:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892118528 00000100:00100000:1.0:1788802183.569397:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788802183.569406:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892118528:12345-0@lo:503: 00000100:00100000:1.0:1788802183.569612:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892118528:12345-0@lo:503: Request processed in 206us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802183.569719:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788802183.570285:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892118528:0@lo:503: 00000100:00100000:0.0:1788802183.571147:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8457:1875694892118656:0@lo:502: 00000100:00100000:0.0:1788802183.571235:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.571369:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.577654:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892118656 00000100:00100000:3.0:1788802183.577681:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892118656 00000100:00100000:3.0:1788802183.577775:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788802183.577789:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:8457:x1875694892118656:12345-0@lo:502: 00000100:00100000:3.0:1788802183.580019:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:8457:x1875694892118656:12345-0@lo:502: Request processed in 2222us (8772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.580037:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788802183.580568:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8457:1875694892118656:0@lo:502: 00000100:00100000:0.0:1788802183.580659:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8457:1875694892118784:0@lo:502: 00000100:00100000:0.0:1788802183.580722:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.580778:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.583592:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892118784 00000100:00100000:1.0:1788802183.583612:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892118784 00000100:00100000:1.0:1788802183.583704:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788802183.583718:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:8457:x1875694892118784:12345-0@lo:502: 00000100:00100000:1.0:1788802183.584228:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:8457:x1875694892118784:12345-0@lo:502: Request processed in 512us (3504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802183.584280:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788802183.585211:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8457:1875694892118784:0@lo:502: 00000040:00080000:0.0:1788802183.585283:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788802183.585565:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788802183.585591:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788802183.585604:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.585617:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802183.585629:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788802183.585633:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788802183.585636:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788802183.585693:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.585703:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.585715:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802183.585738:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892118912:0@lo:101: 00000100:00100000:2.0:1788802183.585797:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802183.585851:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.586175:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892118912 00000100:00100000:3.0:1788802183.586185:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892118912 00000100:00100000:3.0:1788802183.586266:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788802183.586276:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+13:5840:x1875694892118912:12345-0@lo:101: 00010000:00010000:3.0:1788802183.586289:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802183.586304:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d00030600/0x6ecba1490fc9bd84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bd7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802183.586331:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d00030600/0x6ecba1490fc9bd84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd7d expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802183.586343:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d00030600/0x6ecba1490fc9bd84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd7d expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802183.586364:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d00030600, rc 0) 00000100:00100000:3.0:1788802183.587165:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892118912:12345-0@lo:101: Request processed in 887us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.587174:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788802183.587483:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892118912:0@lo:101: 00010000:00010000:2.0:1788802183.587504:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.587516:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802183.587596:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892119040:0@lo:501: 00000100:00100000:2.0:1788802183.587634:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802183.587673:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.587780:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892119040 00000100:00100000:1.0:1788802183.587787:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892119040 00000100:00100000:1.0:1788802183.587827:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788802183.587837:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892119040:12345-0@lo:501: 00000100:00100000:1.0:1788802183.588207:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892119040:12345-0@lo:501: Request processed in 370us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802183.588215:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788802183.588768:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892119040:0@lo:501: 00000100:00100000:2.0:1788802183.588811:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892119168:0@lo:503: 00000100:00100000:2.0:1788802183.588876:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802183.588911:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.589600:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892119168 00000100:00100000:3.0:1788802183.589609:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892119168 00000100:00100000:3.0:1788802183.589669:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788802183.589679:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892119168:12345-0@lo:503: 00000100:00100000:3.0:1788802183.591029:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892119168:12345-0@lo:503: Request processed in 1341us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.591044:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788802183.596691:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892119168:0@lo:503: 00000100:00100000:0.0:1788802183.597837:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8458:1875694892119296:0@lo:502: 00000100:00100000:0.0:1788802183.597966:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.598026:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.598331:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892119296 00000100:00100000:1.0:1788802183.598342:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892119296 00000100:00100000:1.0:1788802183.598416:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788802183.598610:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:8458:x1875694892119296:12345-0@lo:502: 00000100:00100000:1.0:1788802183.598954:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:8458:x1875694892119296:12345-0@lo:502: Request processed in 527us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802183.598962:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788802183.599182:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8458:1875694892119296:0@lo:502: 00000020:01000000:0.0:1788802183.599220:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788802183.599232:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802183.599235:0:8458:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788802183.599276:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788802183.599322:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8458:1875694892119424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802183.599366:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.599417:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802183.599602:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892119424 00000100:00100000:2.0:1788802183.599609:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892119424 00000100:00100000:2.0:1788802183.599662:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788802183.599670:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:8458:x1875694892119424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802183.599838:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:8458:x1875694892119424:12345-0@lo:502:llog_process_th.0 Request processed in 168us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802183.599845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788802183.599984:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8458:1875694892119424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788802183.600005:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802183.600010:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802183.600011:0:8458:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788802183.600015:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788802183.600369:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788802183.600612:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788802183.600624:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.600638:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802183.600650:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788802183.600654:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d1d17c800 from 39 10000000:01000000:2.0:1788802183.600658:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788802183.600696:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.600704:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.600714:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802183.600735:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892119552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788802183.600782:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802183.600812:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553000 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.601230:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892119552 00000100:00100000:1.0:1788802183.601267:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892119552 00000100:00100000:1.0:1788802183.601317:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788802183.601327:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:5840:x1875694892119552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802183.601341:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802183.601359:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01681200/0x6ecba1490fc9bd92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bd8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.601400:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01681200/0x6ecba1490fc9bd92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd8b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.601413:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01681200/0x6ecba1490fc9bd92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd8b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.601423:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01681200, rc 0) 00000100:00100000:1.0:1788802183.601721:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892119552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 395us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802183.601728:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788802183.602579:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892119552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788802183.602604:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802183.602617:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802183.602706:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892119680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802183.602759:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.602802:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.602895:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892119680 00000100:00100000:3.0:1788802183.602902:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892119680 00000100:00100000:3.0:1788802183.602950:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788802183.602960:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892119680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.603643:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892119680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 683us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.603653:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788802183.603876:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892119680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802183.603921:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892119808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802183.603964:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.604059:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802183.608596:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892119808 00000100:00100000:2.0:1788802183.608645:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892119808 00000100:00100000:2.0:1788802183.608784:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788802183.608799:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892119808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802183.609164:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892119808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 368us (5197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802183.609173:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788802183.609315:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892119808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802183.616758:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8459:1875694892119936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802183.616888:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.618872:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.632974:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892119936 00000100:00100000:1.0:1788802183.633001:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892119936 00000100:00100000:1.0:1788802183.633098:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788802183.633111:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:8459:x1875694892119936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788802183.633571:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:8459:x1875694892119936:12345-0@lo:502:llog_process_th.0 Request processed in 462us (16682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802183.633581:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788802183.633917:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8459:1875694892119936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802183.634011:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8459:1875694892120064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802183.634089:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.634127:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802183.634262:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892120064 00000100:00100000:2.0:1788802183.634268:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892120064 00000100:00100000:2.0:1788802183.634302:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788802183.634310:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:8459:x1875694892120064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802183.634510:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:8459:x1875694892120064:12345-0@lo:502:llog_process_th.0 Request processed in 199us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802183.634517:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788802183.634671:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8459:1875694892120064:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788802183.634692:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788802183.635062:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788802183.635089:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788802183.635102:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.635115:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802183.635126:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788802183.635130:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788802183.635133:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788802183.635172:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.635181:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.635203:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802183.635224:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892120192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788802183.635340:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802183.635375:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d125530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.635714:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892120192 00000100:00100000:1.0:1788802183.635721:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892120192 00000100:00100000:1.0:1788802183.635756:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788802183.635765:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:5840:x1875694892120192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802183.635776:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802183.635791:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bda0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bd99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.635819:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd99 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.635831:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bd99 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.635841:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01680a00, rc 0) 00000100:00100000:1.0:1788802183.635907:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892120192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802183.635914:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788802183.635992:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892120192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788802183.636007:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802183.636017:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802183.636092:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892120320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802183.636121:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802183.636154:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.636297:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892120320 00000100:00100000:1.0:1788802183.636302:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892120320 00000100:00100000:1.0:1788802183.636320:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788802183.636327:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892120320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802183.636648:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892120320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802183.636656:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788802183.637223:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892120320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802183.637285:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a68b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892120448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788802183.637345:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802183.637380:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0739e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.639193:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892120448 00000100:00100000:3.0:1788802183.639212:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892120448 00000100:00100000:3.0:1788802183.639320:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788802183.639333:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892120448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.639685:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892120448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 355us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.639694:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788802183.639780:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a68b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892120448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.640080:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8460:1875694892120576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.640127:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802183.640149:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892120576 00000100:00100000:3.0:1788802183.640153:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892120576 00000100:00100000:3.0:1788802183.640169:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788802183.640174:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:8460:x1875694892120576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.640332:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:8460:x1875694892120576:12345-0@lo:502:llog_process_th.0 Request processed in 157us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.640340:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788802183.640366:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d06335240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.640378:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8460:1875694892120576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788802183.640398:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788802183.640408:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802183.640410:0:8460:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788802183.640416:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788802183.640433:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8460:1875694892120704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.640460:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802183.640475:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892120704 00000100:00100000:3.0:1788802183.640478:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892120704 00000100:00100000:3.0:1788802183.640491:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788802183.640496:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:8460:x1875694892120704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.640592:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:8460:x1875694892120704:12345-0@lo:502:llog_process_th.0 Request processed in 95us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.640599:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788802183.640624:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.640642:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8460:1875694892120704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788802183.640658:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802183.640662:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802183.640664:0:8460:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788802183.640668:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788802183.640729:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788802183.640751:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788802183.640761:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802183.640774:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802183.640786:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788802183.640789:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d054ea800 from 39 10000000:01000000:3.0:1788802183.640792:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788802183.640821:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802183.640831:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802183.640842:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802183.640864:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892120832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.640893:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802183.640907:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d06335240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.640919:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892120832 00000100:00100000:3.0:1788802183.640923:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892120832 00000100:00100000:3.0:1788802183.640947:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788802183.640952:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892120832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802183.640961:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802183.640975:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d00031400/0x6ecba1490fc9bdae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bda7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802183.641000:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d00031400/0x6ecba1490fc9bdae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bda7 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802183.641013:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d00031400/0x6ecba1490fc9bdae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bda7 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802183.641022:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d00031400, rc 0) 00000100:00100000:3.0:1788802183.641049:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892120832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.641056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788802183.641084:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892120832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802183.641096:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802183.641105:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802183.641143:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892120960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.641169:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802183.641182:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d06335240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.641191:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892120960 00000100:00100000:3.0:1788802183.641195:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892120960 00000100:00100000:3.0:1788802183.641217:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788802183.641223:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892120960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.641518:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892120960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.641526:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788802183.641556:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892120960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.641582:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892121088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.641615:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802183.641629:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d06335240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.641640:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892121088 00000100:00100000:3.0:1788802183.641643:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892121088 00000100:00100000:3.0:1788802183.641659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788802183.641665:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892121088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.641803:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892121088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.641810:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788802183.641870:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892121088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.642180:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8461:1875694892121216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.642215:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802183.642262:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892121216 00000100:00100000:3.0:1788802183.642266:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892121216 00000100:00100000:3.0:1788802183.642285:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788802183.642291:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:8461:x1875694892121216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.642462:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:8461:x1875694892121216:12345-0@lo:502:llog_process_th.0 Request processed in 170us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.642475:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788802183.642503:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08174f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.642515:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8461:1875694892121216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.642553:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8461:1875694892121344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.642586:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802183.642604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892121344 00000100:00100000:3.0:1788802183.642608:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892121344 00000100:00100000:3.0:1788802183.642624:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788802183.642630:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:8461:x1875694892121344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.642747:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:8461:x1875694892121344:12345-0@lo:502:llog_process_th.0 Request processed in 115us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.642754:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788802183.642778:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d038ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1788802183.642790:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33838e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8461:1875694892121344:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788802183.642808:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788802183.648398:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788802183.648458:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788802183.648474:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.648490:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802183.648503:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788802183.648507:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788802183.648510:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788802183.648567:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.648577:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802183.648592:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802183.648626:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892121472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788802183.648723:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802183.648802:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553240 going to sleep for 11 seconds 00000100:00100000:0.0:1788802183.649064:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892121472 00000100:00100000:0.0:1788802183.649075:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892121472 00000100:00100000:0.0:1788802183.649143:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788802183.649156:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892121472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788802183.649174:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802183.649190:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f0800/0x6ecba1490fc9bdbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bdb5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802183.649222:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f0800/0x6ecba1490fc9bdbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bdb5 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802183.649286:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f0800/0x6ecba1490fc9bdbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bdb5 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802183.649297:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0800, rc 0) 00000100:00100000:0.0:1788802183.649351:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892121472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802183.649358:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788802183.649566:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892121472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802183.649584:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.649593:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802183.649666:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892121600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802183.649700:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802183.649729:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0739e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788802183.649876:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892121600 00000100:00100000:0.0:1788802183.649880:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892121600 00000100:00100000:0.0:1788802183.649914:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788802183.649923:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892121600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802183.650984:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892121600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1056us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802183.650997:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788802183.658335:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892121600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802183.659373:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892121728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788802183.659770:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802183.660133:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0739e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788802183.665978:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892121728 00000100:00100000:2.0:1788802183.666011:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892121728 00000100:00100000:2.0:1788802183.666108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788802183.666120:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892121728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.666286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802183.666327:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802183.666361:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802183.666389:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802183.666416:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872170880 00000100:00100000:3.0:1788802183.666421:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872170880 00000100:00100000:3.0:1788802183.666471:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:3.0:1788802183.666480:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2358:x1875694872170880:12345-192.168.201.57@tcp:400: 00000100:00100000:3.0:1788802183.666564:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2358:x1875694872170880:12345-192.168.201.57@tcp:400: Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.666581:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:3.0:1788802183.666608:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872171136 00000100:00100000:3.0:1788802183.666612:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872171136 00000100:00100000:3.0:1788802183.666651:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872171008 00000100:00100000:3.0:1788802183.666654:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872171008 00000100:00100000:3.0:1788802183.666679:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788802183.666686:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2358:x1875694872171136:12345-192.168.201.57@tcp:400: 00000100:00100000:3.0:1788802183.666714:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2358:x1875694872171136:12345-192.168.201.57@tcp:400: Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.666721:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788802183.666732:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:3.0:1788802183.666738:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2358:x1875694872171008:12345-192.168.201.57@tcp:400: 00000100:00100000:3.0:1788802183.666761:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2358:x1875694872171008:12345-192.168.201.57@tcp:400: Request processed in 23us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802183.666767:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00080000:3.0:1788802183.666787:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802183.666806:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892121728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 688us (7036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802183.666813:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788802183.666849:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872170752 00000100:00100000:2.0:1788802183.666862:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872170752 00000100:00100000:2.0:1788802183.666880:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 160 00000100:00100000:2.0:1788802183.666887:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+8:2358:x1875694872170752:12345-192.168.201.57@tcp:400: 00000100:00100000:2.0:1788802183.666912:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+8:2358:x1875694872170752:12345-192.168.201.57@tcp:400: Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802183.666919:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 160 00000100:00080000:3.0:1788802183.666965:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788802183.666969:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802183.667059:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892121728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802183.667945:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33839500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8462:1875694892121856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.668019:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802183.668122:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11a073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802183.668682:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892121856 00000100:00100000:2.0:1788802183.668693:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892121856 00000100:00100000:2.0:1788802183.668753:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788802183.668763:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:8462:x1875694892121856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802183.669172:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:8462:x1875694892121856:12345-0@lo:502:llog_process_th.0 Request processed in 410us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802183.669180:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788802183.669405:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33839500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8462:1875694892121856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788802183.669667:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788802183.669681:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802183.669684:0:8462:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788802183.669693:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788802183.669743:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33839500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8462:1875694892121984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802183.669795:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802183.669834:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d038ad780 going to sleep for 11 seconds 00000100:00100000:0.0:1788802183.669891:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892121984 00000100:00100000:0.0:1788802183.669898:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892121984 00000100:00100000:0.0:1788802183.669946:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788802183.669955:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:8462:x1875694892121984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802183.670182:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:8462:x1875694892121984:12345-0@lo:502:llog_process_th.0 Request processed in 227us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802183.670190:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788802183.671186:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33839500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8462:1875694892121984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788802183.671230:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802183.671269:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802183.671272:0:8462:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788802183.671279:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788802183.671550:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788802183.671575:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788802183.671597:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.671610:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802183.671622:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788802183.671636:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff910d10cbcd40 from 1 10000000:01000000:1.0:1788802183.671639:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788802183.671676:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bdc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.671685:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bdc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.671695:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bdc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802183.671717:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892122112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788802183.671774:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802183.671811:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0739e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.671829:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892122112 00000100:00100000:1.0:1788802183.671835:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892122112 00000100:00100000:1.0:1788802183.671888:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788802183.671897:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892122112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802183.671910:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802183.671927:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bdca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bdc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.671957:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bdca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bdc3 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.671970:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bdca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bdc3 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.671980:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01681800, rc 0) 00000100:00100000:1.0:1788802183.672013:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892122112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802183.672035:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788802183.672072:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892122112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802183.672084:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bdc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.672094:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bdc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bdca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802183.672136:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892122240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802183.672158:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802183.672171:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0739e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788802183.672181:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892122240 00000100:00100000:1.0:1788802183.672184:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892122240 00000100:00100000:1.0:1788802183.672200:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788802183.672205:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892122240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802183.672486:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892122240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (326us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788802183.672494:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788802183.672515:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892122240:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788802183.672532:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788802183.672538:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bdc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802183.672546:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bdc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802184.272499:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802185.103531:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892122752:0@lo:400:kworker.0 00000100:00100000:3.0:1788802185.103627:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802185.103713:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788802185.103721:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892122368:0@lo:400:kworker.0 00000100:00100000:3.0:1788802185.103756:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802185.103781:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892122880:0@lo:400:kworker.0 00000100:00100000:3.0:1788802185.103813:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802185.103909:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892122752 00000100:00100000:2.0:1788802185.103920:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892122752 00000100:00100000:2.0:1788802185.103998:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788802185.104010:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892122752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802185.104076:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892122752:12345-0@lo:400:kworker.0 Request processed in 68us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802185.104104:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788802185.104157:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad7100 x1875694892122752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802185.104175:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892122496:0@lo:400:kworker.0 00000100:00100000:2.0:1788802185.104184:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892122752:0@lo:400:kworker.0 00000100:00100000:0.0:1788802185.104207:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788802185.104260:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802185.104418:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875694892122624:0@lo:400:kworker.0 00000100:00100000:1.0:1788802185.111122:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892122880 00000100:00100000:1.0:1788802185.111154:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892122880 00000100:00100000:1.0:1788802185.111235:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892122496 00000100:00100000:1.0:1788802185.111253:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892122496 00000100:00100000:1.0:1788802185.111282:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788802185.111294:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892122880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802185.111433:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892122880:12345-0@lo:400:kworker.0 Request processed in 141us (7618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802185.111441:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788802185.111473:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788802185.111480:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892122496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802185.111514:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892122496:12345-0@lo:400:kworker.0 Request processed in 35us (7306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802185.111522:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788802185.111550:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892122368 00000100:00100000:1.0:1788802185.111556:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892122368 00000100:00080000:3.0:1788802185.111564:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802185.111588:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788802185.111595:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892122368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802185.111633:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892122368:12345-0@lo:400:kworker.0 Request processed in 38us (7876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802185.111640:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788802185.111651:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802185.111689:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892122624 00000100:00100000:1.0:1788802185.111694:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892122624 00000100:00080000:3.0:1788802185.111714:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802185.111731:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788802185.111739:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875694892122624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802185.111880:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892122496:0@lo:400:kworker.0 00000100:00100000:0.0:1788802185.111904:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892123008:0@lo:400:kworker.0 00000100:00100000:1.0:1788802185.112659:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875694892122624:12345-0@lo:400:kworker.0 Request processed in 917us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802185.112675:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788802185.112691:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875694892122624:0@lo:400:kworker.0 00000100:00100000:2.0:1788802185.112784:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892122368:0@lo:400:kworker.0 00000100:00100000:2.0:1788802185.112802:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892122880:0@lo:400:kworker.0 00000100:00100000:0.0:1788802185.112901:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802185.113225:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892123008 00000100:00100000:3.0:1788802185.113231:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892123008 00000100:00100000:3.0:1788802185.113371:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788802185.113381:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892123008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802185.113449:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892123008:12345-0@lo:400:kworker.0 Request processed in 70us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802185.113456:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788802185.113572:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad6300 x1875694892123008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802185.113597:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892123008:0@lo:400:kworker.0 00000100:00080000:0.0:1788802185.113730:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788802185.295557:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802185.612705:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802185.612737:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802185.612849:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802185.614564:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892123136 00000100:00100000:1.0:1788802185.614583:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892123136 00000100:00100000:1.0:1788802185.614678:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788802185.614691:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892123136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802185.614742:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1788802185.616326:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad6300 x1875694892123136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802185.616361:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802185.616467:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892123136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1777us (3616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802185.616478:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1788802186.319793:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802187.253961:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802187.254077:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872171264 00000100:00100000:0.0:1788802187.254093:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872171264 00000100:00100000:0.0:1788802187.254166:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 166 00000100:00100000:0.0:1788802187.254181:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+8:5601:x1875694872171264:12345-192.168.201.57@tcp:101: 00010000:00010000:0.0:1788802187.254205:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802187.254232:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f0600/0x6ecba1490fc9bdd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edeba6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802187.254314:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f0600/0x6ecba1490fc9bdd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeba6 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802187.254328:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f0600/0x6ecba1490fc9bdd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeba6 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802187.254339:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0600, rc 0) 00000100:00100000:0.0:1788802187.254418:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+9:5601:x1875694872171264:12345-192.168.201.57@tcp:101: Request processed in 242us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802187.254449:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 166 00000100:00100000:3.0:1788802187.262528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802187.265694:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872171392 00000100:00100000:2.0:1788802187.265722:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872171392 00000100:00100000:2.0:1788802187.265813:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 167 00000100:00100000:2.0:1788802187.265826:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+9:5601:x1875694872171392:12345-192.168.201.57@tcp:501: 00000100:00100000:2.0:1788802187.266275:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+9:5601:x1875694872171392:12345-192.168.201.57@tcp:501: Request processed in 449us (3757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802187.266296:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 167 00000100:00100000:3.0:1788802187.275603:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802187.276568:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872171520 00000100:00100000:0.0:1788802187.276586:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872171520 00000100:00100000:0.0:1788802187.276948:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 168 00000100:00100000:0.0:1788802187.276964:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+9:5601:x1875694872171520:12345-192.168.201.57@tcp:503: 00000100:00100000:0.0:1788802187.277843:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+9:5601:x1875694872171520:12345-192.168.201.57@tcp:503: Request processed in 875us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802187.277855:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 168 00000100:00100000:1.0:1788802187.286534:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802187.286775:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872171648 00000100:00100000:2.0:1788802187.286788:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872171648 00000100:00100000:2.0:1788802187.286884:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 169 00000100:00100000:2.0:1788802187.286896:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+9:6095:x1875694872171648:12345-192.168.201.57@tcp:502: 00000100:00100000:2.0:1788802187.287292:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+9:6095:x1875694872171648:12345-192.168.201.57@tcp:502: Request processed in 397us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802187.287308:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 169 00000100:00100000:3.0:1788802187.293485:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802187.293662:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872171776 00000100:00100000:0.0:1788802187.293675:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872171776 00000100:00100000:0.0:1788802187.293745:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 170 00000100:00100000:0.0:1788802187.293757:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+9:6095:x1875694872171776:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788802187.294355:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+9:6095:x1875694872171776:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 598us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802187.294366:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 170 00000100:00100000:1.0:1788802187.301467:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802187.301535:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872171904 00000100:00100000:0.0:1788802187.301550:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872171904 00000100:00100000:0.0:1788802187.301684:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 171 00000100:00100000:0.0:1788802187.301698:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+9:5601:x1875694872171904:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788802187.301721:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802187.301745:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f1e00/0x6ecba1490fc9bdd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edebad expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802187.301782:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f1e00/0x6ecba1490fc9bdd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebad expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802187.301835:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f1e00/0x6ecba1490fc9bdd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebad expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802187.301846:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1e00, rc 0) 00000100:00100000:0.0:1788802187.301916:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:5601:x1875694872171904:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 222us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802187.301922:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 171 00000100:00100000:3.0:1788802187.306345:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802187.308264:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872172032 00000100:00100000:0.0:1788802187.308284:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872172032 00000100:00100000:0.0:1788802187.308376:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 172 00000100:00100000:0.0:1788802187.308388:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:5601:x1875694872172032:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802187.309686:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:5601:x1875694872172032:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 1285us (3340us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788802187.309703:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 172 00010000:00010000:0.0:1788802187.340471:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802187.661397:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788802187.661430:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892123264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802187.661544:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802187.661656:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892123264 00000100:00100000:2.0:1788802187.661668:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892123264 00000100:00100000:2.0:1788802187.661748:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788802187.661760:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892123264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788802187.661815:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802187.661884:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892123264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802187.661892:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788802187.661917:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788802187.661955:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad7800 x1875694892123264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802187.661978:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892123264:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788802188.367177:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802188.786349:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802188.786407:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802188.786439:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802188.786497:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802188.786535:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872172416 00000100:00100000:3.0:1788802188.786547:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872172416 00000100:00100000:3.0:1788802188.786610:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872172544 00000100:00100000:3.0:1788802188.786614:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872172544 00000100:00100000:3.0:1788802188.786640:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:3.0:1788802188.786650:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872172416:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802188.786740:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872172416:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 90us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802188.786748:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:3.0:1788802188.786775:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788802188.786783:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872172544:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802188.786813:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872172544:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802188.786820:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:2.0:1788802188.788802:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872172160 00000100:00100000:2.0:1788802188.788817:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872172160 00000100:00100000:2.0:1788802188.788881:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 173 00000100:00100000:2.0:1788802188.788891:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872172160:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802188.788982:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872172160:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 91us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802188.788984:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872172288 00000100:00100000:2.0:1788802188.788992:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 173 00000100:00080000:2.0:1788802188.789041:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802188.789046:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802188.789583:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872172288 00000100:00100000:3.0:1788802188.789655:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:3.0:1788802188.789669:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872172288:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802188.789747:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872172288:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 84us (3307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802188.789754:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00080000:2.0:1788802188.790399:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788802189.010597:0:8501:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5a50bfb0 20000000:00000080:0.0:1788802189.010621:0:8501:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910d3fc24800 uarg=0000000000000000 20000000:01000000:0.0:1788802189.010664:0:8501:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788802189.010670:0:8501:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788802189.010676:0:8501:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788802189.013089:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788802189.013509:0:8501:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788802189.019893:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788802189.019966:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788802189.020035:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788802189.020053:0:8501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788802189.020081:0:8501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802189.020101:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d01681600/0x6ecba1490fc9bb54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bb4d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802189.020109:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9bbb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bbaf expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802189.020115:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216f400/0x6ecba1490fc9bc81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bc7a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802189.020125:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216ea00/0x6ecba1490fc9bd3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb75 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802189.020131:0:8501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802189.020175:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216ea00/0x6ecba1490fc9bd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb75 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802189.020192:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d4216ea00/0x6ecba1490fc9bd3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb75 expref: 9 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802189.020222:0:8501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1875694892123392:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802189.020370:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216f400/0x6ecba1490fc9bc81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bc7a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802189.020379:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d4216f400/0x6ecba1490fc9bc81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc7a expref: 18 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802189.020389:0:8501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1875694892123520:0@lo:104: 00000100:00100000:3.0:1788802189.020432:0:8501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788802189.020472:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9bbb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bbaf expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802189.020481:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9bbb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbaf expref: 18 pid: 5834 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802189.020490:0:8501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1875694892123648:0@lo:104: 00000100:00100000:3.0:1788802189.020512:0:8501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788802189.020531:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d01681600/0x6ecba1490fc9bb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bb4d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802189.020539:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d01681600/0x6ecba1490fc9bb54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb4d expref: 18 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802189.020547:0:8501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1875694892123776:0@lo:104: 00000100:00100000:3.0:1788802189.020565:0:8501:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d038ad000 going to sleep for 11 seconds 00000100:00100000:2.0:1788802189.020863:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788802189.020883:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802189.020895:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892123520 00000100:00100000:2.0:1788802189.020903:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892123520 00000100:00100000:2.0:1788802189.020942:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892123648 00000100:00100000:2.0:1788802189.020945:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892123648 00000100:00100000:2.0:1788802189.020954:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892123776 00000100:00100000:2.0:1788802189.020957:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892123776 00000100:00100000:2.0:1788802189.020969:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788802189.020977:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:8501:x1875694892123520:12345-0@lo:104: 00010000:00010000:2.0:1788802189.021001:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802189.021070:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788802189.021076:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:8501:x1875694892123520:12345-0@lo:104: Request processed in 100us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802189.021082:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788802189.021099:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788802189.021104:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:8501:x1875694892123648:12345-0@lo:104: 00010000:00010000:2.0:1788802189.021113:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802189.021148:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788802189.021153:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:8501:x1875694892123648:12345-0@lo:104: Request processed in 50us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802189.021159:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788802189.021193:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788802189.021198:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:8501:x1875694892123776:12345-0@lo:104: 00010000:00010000:2.0:1788802189.021216:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d4216f800/0x6ecba1490fc9bb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802189.021272:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788802189.021278:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:8501:x1875694892123776:12345-0@lo:104: Request processed in 80us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802189.021283:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788802189.021878:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788802189.021887:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.021897:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1400 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802189.021901:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.021920:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802189.021927:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802189.021942:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788802189.021986:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022003:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802189.022026:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022033:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d206f1400/0x6ecba1490fc9bc7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bc81 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022046:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788802189.022049:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022055:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d6800 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802189.022058:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022065:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802189.022070:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802189.022075:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788802189.022088:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022093:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802189.022115:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022122:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d029d6800/0x6ecba1490fc9bbaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bbb6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022131:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802189.022134:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d4216f800/0x6ecba1490fc9bb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022139:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f800 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802189.022142:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d4216f800/0x6ecba1490fc9bb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022148:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d4216f800/0x6ecba1490fc9bb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802189.022155:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d4216f800/0x6ecba1490fc9bb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802189.022160:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788802189.022172:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d4216f800/0x6ecba1490fc9bb4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022176:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802189.022181:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d4216f800/0x6ecba1490fc9bb4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022187:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d4216f800/0x6ecba1490fc9bb4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bb54 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022199:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802189.022205:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802189.022207:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802189.022214:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802189.022229:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892123904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802189.022312:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802189.022362:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892124032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802189.022387:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802189.022404:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788802189.022409:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892124160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802189.022427:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802189.022470:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892123904 00000100:00100000:1.0:1788802189.022477:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892123904 00010000:00010000:1.0:1788802189.022503:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216f400/0x6ecba1490fc9bc81 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc7a expref: 19 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802189.022529:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892124032 00000100:00100000:1.0:1788802189.022532:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892124032 00010000:00010000:1.0:1788802189.022543:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9bbb6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbaf expref: 20 pid: 5834 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802189.022552:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892124160 00000100:00100000:1.0:1788802189.022555:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892124160 00010000:00010000:1.0:1788802189.022565:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d01681600/0x6ecba1490fc9bb54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb4d expref: 21 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802189.022577:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788802189.022584:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a688380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+21:3314:x1875694892123904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802189.022598:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802189.022604:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216f400/0x6ecba1490fc9bc81 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc7a expref: 21 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022620:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216f400/0x6ecba1490fc9bc81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bc7a expref: 21 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022636:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802189.022667:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a688380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+21:3314:x1875694892123904:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802189.022674:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788802189.022690:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788802189.022697:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+20:3311:x1875694892124032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802189.022705:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802189.022709:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9bbb6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbaf expref: 20 pid: 5834 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022717:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9bbb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bbaf expref: 20 pid: 5834 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022725:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802189.022750:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+20:3311:x1875694892124032:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802189.022756:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788802189.022782:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788802189.022788:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892124160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802189.022795:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802189.022799:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d01681600/0x6ecba1490fc9bb54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb4d expref: 19 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022806:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d01681600/0x6ecba1490fc9bb54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bb4d expref: 19 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802189.022821:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802189.022844:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892124160:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802189.022850:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788802189.022893:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892124160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802189.022902:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a68ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892124032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802189.022926:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892123904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788802189.023353:0:8501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216f400/0x6ecba1490fc9bc81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bc7a expref: 18 pid: 5837 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802189.023379:0:8501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1875694892123520:0@lo:104: 00010000:00010000:3.0:1788802189.023392:0:8501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216ec00/0x6ecba1490fc9bbb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bbaf expref: 17 pid: 5834 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802189.023401:0:8501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1875694892123648:0@lo:104: 00010000:00010000:3.0:1788802189.023410:0:8501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01681600/0x6ecba1490fc9bb54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bb4d expref: 16 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802189.023417:0:8501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1875694892123776:0@lo:104: 00010000:00010000:1.0:1788802189.024229:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802189.030601:0:8501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1875694892123392:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802189.030643:0:8501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802189.031836:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802189.032112:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872172672 00000100:00100000:0.0:1788802189.032134:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872172672 00010000:00010000:0.0:1788802189.032174:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216ea00/0x6ecba1490fc9bd3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb75 expref: 10 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802189.032220:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:0.0:1788802189.032231:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2359:x1875694872172672:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788802189.032272:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802189.032279:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216ea00/0x6ecba1490fc9bd3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb75 expref: 10 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032293:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216ea00/0x6ecba1490fc9bd3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb75 expref: 10 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032313:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216ea00/0x6ecba1490fc9bd3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb75 expref: 10 pid: 5836 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032332:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032341:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032359:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032366:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032373:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032390:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032396:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d00030400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802189.032401:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032410:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032425:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032436:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802189.032512:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f34e9515-dc55-4812-97ce-617e4dd802db+9:2359:x1875694872172672:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 282us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802189.032520:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00010000:00010000:0.0:1788802189.032549:0:8501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032557:0:8501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.032564:0:8501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d00030400/0x6ecba1490fc9bddf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802189.289899:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802189.290798:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872172800 00000100:00100000:0.0:1788802189.290809:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872172800 00000100:00100000:0.0:1788802189.290869:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 174 00000100:00100000:0.0:1788802189.290878:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+9:5601:x1875694872172800:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788802189.291010:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802189.291030:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9bde6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edebb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.291068:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9bde6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebb4 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.291081:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9bde6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebb4 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802189.291090:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1000, rc 0) 00000100:00100000:0.0:1788802189.291425:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:5601:x1875694872172800:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 547us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802189.291432:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 174 00000100:00100000:1.0:1788802189.316324:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802189.316439:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872172928 00000100:00100000:0.0:1788802189.316451:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872172928 00000100:00100000:0.0:1788802189.316517:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 175 00000100:00100000:0.0:1788802189.316528:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:5601:x1875694872172928:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802189.316934:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:5601:x1875694872172928:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 406us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802189.316943:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 175 00000100:00100000:0.0:1788802189.322257:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802189.322458:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872173056 00000100:00100000:2.0:1788802189.322472:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872173056 00000100:00100000:2.0:1788802189.322529:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 176 00000100:00100000:2.0:1788802189.322541:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:5601:x1875694872173056:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802189.322787:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:5601:x1875694872173056:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 246us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802189.322796:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 176 00000100:00100000:1.0:1788802189.331221:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802189.331387:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872173184 00000100:00100000:0.0:1788802189.331398:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872173184 00000100:00100000:0.0:1788802189.331458:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 177 00000100:00100000:0.0:1788802189.331469:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:6136:x1875694872173184:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788802189.331738:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:6136:x1875694872173184:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 269us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802189.331746:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 177 00000100:00100000:0.0:1788802189.338035:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802189.338167:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872173312 00000100:00100000:3.0:1788802189.338178:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872173312 00000100:00100000:3.0:1788802189.338283:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 178 00000100:00100000:3.0:1788802189.338295:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:6136:x1875694872173312:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788802189.338563:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:6136:x1875694872173312:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 269us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802189.338572:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 178 00010000:00010000:1.0:1788802189.388731:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802190.220874:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892124544:0@lo:400:kworker.0 00000100:00100000:0.0:1788802190.220942:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802190.220992:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802190.220998:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892124672:0@lo:400:kworker.0 00000100:00100000:0.0:1788802190.221022:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802190.221058:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892124544 00000100:00100000:0.0:1788802190.221065:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892124544 00000100:00100000:0.0:1788802190.221115:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788802190.221123:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892124544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802190.221167:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892124544:12345-0@lo:400:kworker.0 Request processed in 46us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802190.221174:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788802190.221194:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892124672 00000100:00100000:0.0:1788802190.221198:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892124672 00000100:00100000:0.0:1788802190.221222:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788802190.221228:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892124672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802190.221332:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892124672:12345-0@lo:400:kworker.0 Request processed in 103us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802190.221339:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788802190.221355:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788802190.221360:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802190.221549:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892124416:0@lo:400:kworker.0 00000100:00100000:3.0:1788802190.221580:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802190.221598:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892124928:0@lo:400:kworker.0 00000100:00100000:3.0:1788802190.221617:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802190.221637:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788802190.221643:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892124288:0@lo:400:kworker.0 00000100:00100000:3.0:1788802190.221664:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802190.221693:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892124800:0@lo:400:kworker.0 00000100:00100000:3.0:1788802190.221711:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802190.221732:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892124928 00000100:00100000:3.0:1788802190.221736:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892124928 00000100:00100000:3.0:1788802190.221779:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788802190.221785:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892124928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802190.221818:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892124928:12345-0@lo:400:kworker.0 Request processed in 34us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802190.221825:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788802190.221842:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892124288 00000100:00100000:3.0:1788802190.221845:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892124288 00000100:00100000:3.0:1788802190.221867:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788802190.221872:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3314:x1875694892124288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802190.221899:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3314:x1875694892124288:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802190.221905:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788802190.221940:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892124288:0@lo:400:kworker.0 00010000:00080000:3.0:1788802190.221954:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a96680 x1875694892124928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802190.221965:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892124928:0@lo:400:kworker.0 00000100:00100000:1.0:1788802190.222288:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892124416 00000100:00100000:1.0:1788802190.222294:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892124416 00000100:00100000:1.0:1788802190.222317:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892124800 00000100:00100000:1.0:1788802190.222319:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892124800 00000100:00100000:1.0:1788802190.222335:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788802190.222341:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892124416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802190.222382:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892124416:12345-0@lo:400:kworker.0 Request processed in 41us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802190.222388:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788802190.222401:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788802190.222406:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892124800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802190.222430:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892124800:12345-0@lo:400:kworker.0 Request processed in 24us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802190.222435:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788802190.222469:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892124800:0@lo:400:kworker.0 00000100:00100000:1.0:1788802190.222479:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892124416:0@lo:400:kworker.0 00010000:00080000:0.0:1788802190.222529:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a97480 x1875694892124672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802190.222546:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892124672:0@lo:400:kworker.0 00000100:00100000:0.0:1788802190.222560:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892124544:0@lo:400:kworker.0 00000100:00080000:0.0:1788802190.222584:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788802190.222589:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788802190.412369:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788802190.606185:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788802190.606194:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d0450e000 from 4 10000000:01000000:2.0:1788802190.606201:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788802190.606299:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802190.606313:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802190.606325:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802190.606353:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.606469:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802190.606545:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802190.608563:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892125056 00000100:00100000:3.0:1788802190.608584:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892125056 00000100:00100000:3.0:1788802190.608665:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788802190.608679:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892125056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802190.608701:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802190.608752:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d00031000/0x6ecba1490fc9bdf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bded expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802190.608795:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d00031000/0x6ecba1490fc9bdf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bded expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802190.608810:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d00031000/0x6ecba1490fc9bdf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bded expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802190.608820:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d00031000, rc 0) 00000100:00100000:3.0:1788802190.608923:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892125056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802190.608931:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788802190.609064:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802190.609083:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802190.609092:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802190.609165:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.609196:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802190.609231:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802190.609908:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892125184 00000100:00100000:3.0:1788802190.609918:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892125184 00000100:00100000:3.0:1788802190.609963:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788802190.609975:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892125184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802190.610679:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892125184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 703us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802190.610689:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788802190.610803:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.610991:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.612161:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802190.612215:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788802190.612617:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892125312 00000100:00100000:0.0:1788802190.612627:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892125312 00000100:00100000:0.0:1788802190.612690:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788802190.612702:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892125312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802190.612979:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892125312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802190.612989:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788802190.613131:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.613639:0:8574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8574:1875694892125440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802190.613687:0:8574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802190.613729:0:8574:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788802190.616116:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892125440 00000100:00100000:0.0:1788802190.616137:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892125440 00000100:00100000:0.0:1788802190.616211:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788802190.616225:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:8574:x1875694892125440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802190.617099:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:8574:x1875694892125440:12345-0@lo:502:llog_process_th.0 Request processed in 876us (3409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802190.617110:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788802190.618461:0:8574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8574:1875694892125440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788802190.618528:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802190.618544:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802190.618546:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788802190.618555:0:8574:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d0450e000 00000020:00000080:2.0:1788802190.618568:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788802190.618772:0:8574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8574:1875694892125568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802190.618861:0:8574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802190.618920:0:8574:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788802190.619179:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892125568 00000100:00100000:0.0:1788802190.619189:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892125568 00000100:00100000:0.0:1788802190.619287:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788802190.619298:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:8574:x1875694892125568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802190.619571:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:8574:x1875694892125568:12345-0@lo:502:llog_process_th.0 Request processed in 273us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802190.619579:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788802190.619879:0:8574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8574:1875694892125568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788802190.619913:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802190.619922:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802190.619925:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788802190.619931:0:8574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788802190.620489:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788802190.620515:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788802190.620528:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802190.620544:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802190.620557:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788802190.620561:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d1d17c800 from 4 10000000:01000000:0.0:1788802190.620565:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788802190.620614:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802190.620624:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802190.620637:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802190.620663:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788802190.620724:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802190.621155:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788802190.625080:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892125696 00000100:00100000:2.0:1788802190.625099:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892125696 00000100:00100000:2.0:1788802190.625163:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788802190.625176:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892125696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802190.625199:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802190.625223:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bdfb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802190.625940:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bdfb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802190.625958:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bdfb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802190.625968:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95fc00, rc 0) 00000100:00100000:2.0:1788802190.626146:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892125696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 972us (5421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802190.626154:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788802190.627138:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802190.627188:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802190.627201:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802190.627967:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.628166:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802190.628221:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788802190.628278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892125824 00000100:00100000:2.0:1788802190.628286:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892125824 00000100:00100000:2.0:1788802190.628348:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788802190.628359:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892125824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.629426:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892125824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 866us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802190.629439:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788802190.631049:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802190.631131:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802190.631217:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802190.631291:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788802190.636326:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892125952 00000100:00100000:2.0:1788802190.636359:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892125952 00000100:00100000:2.0:1788802190.636431:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788802190.636443:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892125952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.636779:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892125952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 337us (5561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802190.636789:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788802190.637106:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892125952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.637703:0:8577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8577:1875694892126080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802190.637789:0:8577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802190.637849:0:8577:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802190.639024:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892126080 00000100:00100000:3.0:1788802190.639038:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892126080 00000100:00100000:3.0:1788802190.639098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788802190.639109:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:8577:x1875694892126080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802190.639655:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:8577:x1875694892126080:12345-0@lo:502:llog_process_th.0 Request processed in 545us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802190.639665:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788802190.642229:0:8577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8577:1875694892126080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788802190.642304:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802190.642317:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802190.642319:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788802190.642328:0:8577:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d1d17c800 00000020:00000080:2.0:1788802190.642331:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788802190.645533:0:8577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8577:1875694892126208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802190.645647:0:8577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802190.645710:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892126208 00000100:00100000:2.0:1788802190.645719:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892126208 00000100:00100000:2.0:1788802190.645793:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788802190.645804:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:8577:x1875694892126208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802190.647767:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:8577:x1875694892126208:12345-0@lo:502:llog_process_th.0 Request processed in 1956us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802190.647784:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788802190.647881:0:8577:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802190.647914:0:8577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8577:1875694892126208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788802190.647955:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802190.647964:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802190.647967:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788802190.647973:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788802190.650278:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788802190.650338:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788802190.650355:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802190.650371:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802190.650385:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788802190.650388:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d054ea800 from 4 10000000:01000000:3.0:1788802190.650391:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788802190.650448:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802190.650458:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802190.650474:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802190.651823:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892126336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788802190.651933:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802190.651985:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3a614e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802190.652017:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892126336 00000100:00100000:3.0:1788802190.652026:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892126336 00000100:00100000:3.0:1788802190.652088:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788802190.652098:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892126336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802190.652118:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802190.652142:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d00031600/0x6ecba1490fc9be10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9be09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802190.654605:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d00031600/0x6ecba1490fc9be10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9be09 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802190.654626:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d00031600/0x6ecba1490fc9be10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9be09 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802190.654639:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d00031600, rc 0) 00000100:00100000:3.0:1788802190.655344:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892126336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3240us (3404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802190.655357:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788802190.655458:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892126336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802190.656632:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802190.656729:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802190.656899:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892126464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802190.656986:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802190.657909:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892126464 00000100:00100000:2.0:1788802190.657924:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892126464 00000100:00100000:2.0:1788802190.657994:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788802190.658006:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892126464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802190.663812:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b75c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802190.665357:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892126464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7340us (8358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802190.665375:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788802190.665448:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892126464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.665538:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892126592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.665605:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802190.665642:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802190.665916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892126592 00000100:00100000:2.0:1788802190.665926:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892126592 00000100:00100000:2.0:1788802190.665976:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788802190.665986:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892126592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802190.666290:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892126592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 304us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802190.666298:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788802190.666353:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892126592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802190.674900:0:8579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8579:1875694892126720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802190.675020:0:8579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802190.675080:0:8579:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802190.676610:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892126720 00000100:00100000:2.0:1788802190.676629:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892126720 00000100:00100000:2.0:1788802190.676757:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788802190.676771:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:8579:x1875694892126720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802190.677818:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:8579:x1875694892126720:12345-0@lo:502:llog_process_th.0 Request processed in 1043us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802190.677831:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788802190.678891:0:8579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8579:1875694892126720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788802190.678943:0:8579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788802190.678957:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802190.678961:0:8579:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788802190.678970:0:8579:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d054ea800 00000020:00000080:0.0:1788802190.678973:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788802190.679317:0:8579:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8579:1875694892126848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802190.679401:0:8579:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802190.679447:0:8579:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802190.680088:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892126848 00000100:00100000:2.0:1788802190.680099:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892126848 00000100:00100000:2.0:1788802190.681634:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788802190.682126:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:8579:x1875694892126848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802190.688970:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:8579:x1875694892126848:12345-0@lo:502:llog_process_th.0 Request processed in 6843us (9554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802190.688990:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788802190.695537:0:8579:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:8579:1875694892126848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788802190.695605:0:8579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802190.695617:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802190.695620:0:8579:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788802190.695628:0:8579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788802190.696113:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788802190.696213:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788802190.696230:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802190.696270:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802190.748432:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892126976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802190.748559:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802190.748645:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892126976 00000100:00100000:3.0:1788802190.748816:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892126976 00000100:00100000:3.0:1788802190.748888:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788802190.748900:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892126976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788802190.748947:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802190.749012:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892126976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802190.749020:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788802190.749146:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d0453c000 x1875694892126976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802190.749170:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892126976:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788802191.436512:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802192.460630:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802192.787557:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892127104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802192.788097:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802192.788215:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892127104 00000100:00100000:3.0:1788802192.788227:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892127104 00000100:00100000:3.0:1788802192.788320:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788802192.788332:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892127104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788802192.788383:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802192.789585:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892127104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1247us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802192.789598:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788802192.789768:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802192.791039:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a95f80 x1875694892127104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802192.791072:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892127104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788802193.494850:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802193.905413:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802193.905451:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802193.905476:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802193.905498:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802193.905527:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872173440 00000100:00100000:1.0:1788802193.905538:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872173440 00000100:00100000:1.0:1788802193.905590:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 195 00000100:00100000:1.0:1788802193.905600:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872173440:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802193.905663:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872173440:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 65us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802193.905670:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 195 00000100:00100000:1.0:1788802193.905714:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872173568 00000100:00100000:1.0:1788802193.905717:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872173568 00000100:00100000:1.0:1788802193.905756:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:1.0:1788802193.905763:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872173568:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802193.905790:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872173568:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 28us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802193.905796:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00080000:1.0:1788802193.905813:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802193.908710:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872173696 00000100:00100000:0.0:1788802193.908723:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872173696 00000100:00100000:0.0:1788802193.908788:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872173824 00000100:00100000:0.0:1788802193.908791:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872173824 00000100:00100000:0.0:1788802193.908820:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788802193.908830:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872173696:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802193.908898:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872173696:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 69us (3445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802193.908905:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788802193.908922:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788802193.908929:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872173824:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802193.908952:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872173824:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 24us (3454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802193.908967:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00080000:1.0:1788802193.909322:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788802193.909326:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788802194.510432:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802195.343550:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892127360:0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.343609:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802195.343672:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892127872:0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.343694:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802195.343719:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788802195.343724:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892127232:0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.343745:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802195.343760:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892127744:0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.343775:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802195.343794:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892127488:0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.343811:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802195.343823:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802195.343827:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892127616:0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.343843:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802195.343864:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892127360 00000100:00100000:0.0:1788802195.343871:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892127360 00000100:00100000:0.0:1788802195.343901:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892127744 00000100:00100000:0.0:1788802195.343903:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892127744 00000100:00100000:0.0:1788802195.343919:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892127488 00000100:00100000:0.0:1788802195.343921:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892127488 00000100:00100000:0.0:1788802195.343933:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788802195.343940:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892127360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.343981:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892127360:12345-0@lo:400:kworker.0 Request processed in 41us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802195.343987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788802195.344008:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788802195.344013:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892127744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.344034:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892127744:12345-0@lo:400:kworker.0 Request processed in 22us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802195.344040:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788802195.344048:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788802195.344052:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892127488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.344072:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892127488:12345-0@lo:400:kworker.0 Request processed in 20us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802195.344078:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788802195.344091:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892127872 00000100:00100000:0.0:1788802195.344093:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892127872 00000100:00100000:0.0:1788802195.344111:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892127616 00000100:00100000:0.0:1788802195.344113:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892127616 00000100:00100000:0.0:1788802195.344126:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788802195.344131:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892127872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.344153:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892127872:12345-0@lo:400:kworker.0 Request processed in 22us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802195.344158:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788802195.344166:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788802195.344171:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892127616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.344188:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892127616:12345-0@lo:400:kworker.0 Request processed in 17us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802195.344193:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788802195.344212:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788802195.344216:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788802195.344218:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788802195.344278:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a94a80 x1875694892127616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802195.344292:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892127616:0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.344301:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892127488:0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.344323:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892127744:0@lo:400:kworker.0 00000100:00100000:0.0:1788802195.344330:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892127360:0@lo:400:kworker.0 00010000:00080000:0.0:1788802195.344338:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a94e00 x1875694892127872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802195.344345:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892127872:0@lo:400:kworker.0 00000100:00100000:2.0:1788802195.344484:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892127232 00000100:00100000:2.0:1788802195.344488:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892127232 00000100:00100000:2.0:1788802195.344513:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788802195.344519:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892127232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802195.344550:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892127232:12345-0@lo:400:kworker.0 Request processed in 32us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802195.344556:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788802195.344597:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892127232:0@lo:400:kworker.0 00000001:02000400:0.0:1788802195.522178:0:8800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788802195.532752:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802195.853714:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892128000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788802195.853784:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802195.853849:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892128000 00000100:00100000:2.0:1788802195.853856:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892128000 00000100:00100000:2.0:1788802195.853897:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788802195.853904:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892128000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802195.853958:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802195.853999:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892128000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802195.854006:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788802195.854045:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad4700 x1875694892128000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802195.854063:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892128000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788802196.563836:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802197.589736:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802197.900488:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788802197.900511:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892128128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802197.900583:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802197.900731:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892128128 00000100:00100000:2.0:1788802197.900739:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892128128 00000100:00100000:2.0:1788802197.900797:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788802197.900806:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892128128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788802197.900966:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802197.902990:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892128128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2173us (2395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802197.903005:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788802197.903046:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802197.906036:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad4700 x1875694892128128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802197.906061:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892128128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788802198.611527:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802199.026918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802199.026989:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872174208 00000100:00100000:0.0:1788802199.026999:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872174208 00000100:00100000:0.0:1788802199.027072:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:0.0:1788802199.027082:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2356:x1875694872174208:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:0.0:1788802199.027116:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bd53 00000100:00080000:0.0:1788802199.027127:0:6690:0:(import.c:65:import_set_state_nolock()) ffff910d3efb9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788802199.027166:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788802199.027550:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+2:2356:x1875694872174208:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 467us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802199.027567:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00010000:00010000:0.0:1788802199.027644:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788802199.028268:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802199.033608:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802199.033645:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872174336 00000100:00100000:0.0:1788802199.033655:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872174336 00000100:00100000:0.0:1788802199.033712:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788802199.033723:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2356:x1875694872174336:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:0.0:1788802199.033758:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bd4c 00000100:00080000:0.0:1788802199.033768:0:6687:0:(import.c:65:import_set_state_nolock()) ffff910d12dae000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788802199.033802:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788802199.034115:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+2:2356:x1875694872174336:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 392us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802199.034123:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00010000:00010000:0.0:1788802199.034145:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788802199.035170:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788802199.035230:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802199.035437:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802199.035461:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872174080 00000100:00100000:3.0:1788802199.035468:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872174080 00000100:00100000:3.0:1788802199.035513:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:3.0:1788802199.035522:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872174080:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802199.035604:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872174080:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 83us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802199.035612:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00080000:3.0:1788802199.035629:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802199.042387:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872173952 00000100:00100000:1.0:1788802199.042403:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872173952 00000100:00100000:0.0:1788802199.042857:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 197 00000100:00100000:0.0:1788802199.042869:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872173952:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802199.042943:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872173952:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 75us (7716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802199.042950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 197 00010000:00010000:1.0:1788802199.629937:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788802199.883841:0:9044:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing yml_node 00000100:00100000:2.0:1788802200.463593:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892128384:0@lo:400:kworker.0 00000100:00100000:2.0:1788802200.463664:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802200.463715:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892128896:0@lo:400:kworker.0 00000100:00100000:2.0:1788802200.463741:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802200.463857:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892128256:0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.463892:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802200.463921:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892128512:0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.463944:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802200.463968:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892128640:0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.464002:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802200.464030:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892128384 00000100:00100000:0.0:1788802200.464038:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892128384 00000100:00100000:0.0:1788802200.464085:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892128512 00000100:00100000:0.0:1788802200.464088:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892128512 00000100:00100000:0.0:1788802200.464113:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788802200.464121:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892128384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.464166:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892128384:12345-0@lo:400:kworker.0 Request processed in 47us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802200.464173:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788802200.464363:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788802200.464370:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892128512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.464401:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892128512:12345-0@lo:400:kworker.0 Request processed in 33us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802200.464407:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788802200.464423:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892128896 00000100:00100000:0.0:1788802200.464426:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892128896 00000100:00100000:0.0:1788802200.464457:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892128640 00000100:00100000:0.0:1788802200.464461:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892128640 00000100:00100000:0.0:1788802200.464485:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788802200.464491:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892128896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.464518:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892128896:12345-0@lo:400:kworker.0 Request processed in 28us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802200.464523:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788802200.464532:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788802200.464537:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892128640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.464572:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892128640:12345-0@lo:400:kworker.0 Request processed in 35us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802200.464588:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788802200.464609:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892128256 00000100:00100000:0.0:1788802200.464613:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892128256 00000100:00100000:0.0:1788802200.464640:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788802200.464650:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892128256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.464693:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892128256:12345-0@lo:400:kworker.0 Request processed in 43us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802200.464699:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1788802200.464744:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788802200.464749:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788802200.464751:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788802200.465039:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d04543100 x1875694892128896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802200.465072:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892128896:0@lo:400:kworker.0 00000100:00100000:2.0:1788802200.465101:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892128384:0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.465185:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892128256:0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.465197:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892128768:0@lo:400:kworker.0 00000100:00100000:0.0:1788802200.465224:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802200.465345:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892128512:0@lo:400:kworker.0 00010000:00080000:0.0:1788802200.465396:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad7b80 x1875694892128640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802200.465406:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892128640:0@lo:400:kworker.0 00000100:00100000:3.0:1788802200.465464:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892128768 00000100:00100000:3.0:1788802200.465469:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892128768 00000100:00100000:3.0:1788802200.465519:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788802200.465527:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892128768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802200.465583:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892128768:12345-0@lo:400:kworker.0 Request processed in 57us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802200.465589:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788802200.465665:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802200.465685:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892128768:0@lo:400:kworker.0 00010000:00010000:0.0:1788802200.655512:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802200.976259:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788802200.976283:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892129024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802200.976345:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802200.976400:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892129024 00000100:00100000:0.0:1788802200.976407:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892129024 00000100:00100000:0.0:1788802200.976456:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788802200.976466:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892129024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788802200.976515:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802200.976580:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892129024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802200.976587:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788802200.976634:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a94a80 x1875694892129024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802200.976652:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892129024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788802201.676787:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788802202.563801:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000020:00000080:3.0:1788802202.563812:0:6714:0:(genops.c:885:class_export_put()) final put ffff910d3efbf000/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000020:00000080:0.0:1788802202.563939:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3efbf000/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 for lustre-OST0000 00000020:00000080:0.0:1788802202.563991:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d3efb9800 for lustre-OST0000 00010000:00010000:1.0:1788802202.701967:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802203.021525:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892129152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802203.021596:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802203.021675:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892129152 00000100:00100000:2.0:1788802203.021684:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892129152 00000100:00100000:2.0:1788802203.021737:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788802203.021746:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892129152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788802203.021778:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802203.021820:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892129152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802203.021827:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788802203.021846:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788802203.021873:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d04543100 x1875694892129152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802203.021890:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892129152:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788802203.069724:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000020:00000080:3.0:1788802203.069734:0:7635:0:(genops.c:885:class_export_put()) final put ffff910d12daf800/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000020:00000080:1.0:1788802203.069806:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d12daf800/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 for lustre-OST0001 00000020:00000080:1.0:1788802203.069857:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d12dae000 for lustre-OST0001 00010000:00010000:0.0:1788802203.726711:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802204.154800:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802204.154854:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802204.155202:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872174464 00000100:00100000:1.0:1788802204.155225:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872174464 00000100:00100000:1.0:1788802204.155405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 199 00000100:00100000:1.0:1788802204.155424:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872174464:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802204.155755:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872174464:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 334us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802204.155765:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 199 00000100:00100000:0.0:1788802204.156354:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872174592 00000100:00100000:0.0:1788802204.156366:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872174592 00000100:00100000:0.0:1788802204.156489:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:0.0:1788802204.156516:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872174592:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802204.156578:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872174592:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 67us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802204.156586:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00080000:2.0:1788802204.157060:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788802204.752752:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788802205.520898:0:9238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:2.0:1788802205.580523:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892129408:0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.580595:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802205.580647:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892129920:0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.580695:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802205.580730:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788802205.580751:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892129280:0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.580780:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802205.580800:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892129792:0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.580819:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802205.580843:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892129536:0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.580865:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802205.580884:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788802205.580889:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892129664:0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.580908:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802205.580937:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892129408 00000100:00100000:2.0:1788802205.580944:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892129408 00000100:00100000:2.0:1788802205.580981:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892129792 00000100:00100000:2.0:1788802205.580984:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892129792 00000100:00100000:2.0:1788802205.581005:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892129536 00000100:00100000:2.0:1788802205.581008:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892129536 00000100:00100000:2.0:1788802205.581025:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788802205.581034:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892129408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.581087:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892129408:12345-0@lo:400:kworker.0 Request processed in 53us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802205.581094:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788802205.581111:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788802205.581117:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892129792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.581143:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892129792:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802205.581150:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788802205.581160:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788802205.581166:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892129536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.581203:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892129536:12345-0@lo:400:kworker.0 Request processed in 37us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802205.581209:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788802205.581228:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892129920 00000100:00100000:2.0:1788802205.581231:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892129920 00000100:00100000:2.0:1788802205.581284:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892129664 00000100:00100000:2.0:1788802205.581288:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892129664 00000100:00100000:2.0:1788802205.581309:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788802205.581316:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892129920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.581346:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892129920:12345-0@lo:400:kworker.0 Request processed in 31us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802205.581352:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788802205.581363:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788802205.581369:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892129664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.581394:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892129664:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802205.581399:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788802205.581416:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892129280 00000100:00100000:2.0:1788802205.581419:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892129280 00000100:00100000:2.0:1788802205.581441:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788802205.581448:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892129280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.581488:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892129280:12345-0@lo:400:kworker.0 Request processed in 40us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802205.581494:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1788802205.581525:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788802205.581530:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802205.581533:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788802205.581572:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d04541180 x1875694892129664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802205.581586:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892129664:0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.581596:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892129536:0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.581621:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892129280:0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.581630:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892129792:0@lo:400:kworker.0 00000100:00100000:2.0:1788802205.581638:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892129408:0@lo:400:kworker.0 00010000:00080000:2.0:1788802205.581646:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d04543480 x1875694892129920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802205.581654:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892129920:0@lo:400:kworker.0 00010000:00010000:2.0:1788802205.774023:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802206.099526:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802206.099552:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892130048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802206.099654:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802206.099922:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892130048 00000100:00100000:1.0:1788802206.099931:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892130048 00000100:00100000:1.0:1788802206.099989:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788802206.100000:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892130048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802206.100033:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802206.100083:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892130048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802206.100090:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788802206.100186:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3f480 x1875694892130048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802206.100205:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892130048:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788802206.797525:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802207.826165:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802208.143807:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892130176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802208.143879:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802208.144123:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892130176 00000100:00100000:1.0:1788802208.144140:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892130176 00000100:00100000:1.0:1788802208.144198:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788802208.144208:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892130176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788802208.144266:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802208.144316:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892130176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802208.144324:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788802208.144347:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788802208.144378:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a94a80 x1875694892130176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802208.144397:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892130176:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788802208.504909:0:9335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1788802208.846078:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802209.265418:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802209.265461:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802209.265524:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872174720 00000100:00100000:2.0:1788802209.265536:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872174720 00000100:00100000:2.0:1788802209.265599:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 201 00000100:00100000:2.0:1788802209.265620:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872174720:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802209.265694:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872174720:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 87us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802209.265701:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 201 00000100:00100000:1.0:1788802209.267138:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872174848 00000100:00100000:1.0:1788802209.267152:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872174848 00000100:00100000:1.0:1788802209.267267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:1.0:1788802209.267279:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872174848:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802209.267361:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872174848:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 84us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802209.267369:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00080000:2.0:1788802209.267637:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788802209.868489:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802210.700530:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892130432:0@lo:400:kworker.0 00000100:00100000:3.0:1788802210.700554:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892130688:0@lo:400:kworker.0 00000100:00100000:2.0:1788802210.700619:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802210.700792:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892130304:0@lo:400:kworker.0 00000100:00100000:0.0:1788802210.700845:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802210.700951:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802210.701100:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892130944:0@lo:400:kworker.0 00000100:00100000:0.0:1788802210.701101:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892130816:0@lo:400:kworker.0 00000100:00100000:2.0:1788802210.701127:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802210.701127:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802210.701159:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892130560:0@lo:400:kworker.0 00000100:00100000:2.0:1788802210.701164:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892130432 00000100:00100000:2.0:1788802210.701171:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892130432 00000100:00100000:0.0:1788802210.701182:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802210.701208:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892130816 00000100:00100000:0.0:1788802210.701209:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892130304 00000100:00100000:2.0:1788802210.701211:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892130816 00000100:00100000:0.0:1788802210.701211:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892130304 00000100:00100000:2.0:1788802210.701233:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892130560 00000100:00100000:2.0:1788802210.701254:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892130560 00000100:00100000:0.0:1788802210.701259:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788802210.701268:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892130304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802210.701270:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788802210.701275:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892130432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802210.701321:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892130432:12345-0@lo:400:kworker.0 Request processed in 44us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802210.701328:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788802210.701329:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892130304:12345-0@lo:400:kworker.0 Request processed in 63us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802210.701335:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788802210.701347:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788802210.701353:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892130816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802210.701362:0:5844:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788802210.701369:0:5844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788802210.701391:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892130816:12345-0@lo:400:kworker.0 Request processed in 26us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802210.701396:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788802210.701397:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788802210.701404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788802210.701407:0:5843:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788802210.701410:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892130560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802210.701420:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892130688 00000100:00100000:2.0:1788802210.701424:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892130688 00000100:00100000:0.0:1788802210.701442:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892130560:12345-0@lo:400:kworker.0 Request processed in 33us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802210.701445:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892130944 00000100:00100000:2.0:1788802210.701448:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892130944 00000100:00100000:0.0:1788802210.701449:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788802210.701466:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788802210.701471:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892130688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802210.701502:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892130688:12345-0@lo:400:kworker.0 Request processed in 31us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802210.701508:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788802210.701517:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788802210.701522:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892130944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802210.701558:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892130944:12345-0@lo:400:kworker.0 Request processed in 36us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802210.701564:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788802210.701573:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892130560:0@lo:400:kworker.0 00000100:00080000:2.0:1788802210.701583:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802210.701587:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788802210.701591:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802210.701616:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892130304:0@lo:400:kworker.0 00010000:00080000:2.0:1788802210.701618:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d0453ea00 x1875694892130944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802210.701624:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892130816:0@lo:400:kworker.0 00000100:00100000:2.0:1788802210.701629:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892130944:0@lo:400:kworker.0 00000100:00100000:2.0:1788802210.701638:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892130432:0@lo:400:kworker.0 00010000:00080000:3.0:1788802210.702171:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d0453dc00 x1875694892130688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802210.702185:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892130688:0@lo:400:kworker.0 00010000:00010000:0.0:1788802210.895832:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788802210.902416:0:9434:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:0.0:1788802211.215021:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892131072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802211.215129:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802211.215275:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892131072 00000100:00100000:2.0:1788802211.215287:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892131072 00000100:00100000:2.0:1788802211.215347:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788802211.215358:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892131072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802211.215407:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802211.215892:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892131072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 533us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802211.215901:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788802211.216114:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3f480 x1875694892131072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802211.216137:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892131072:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788802211.919789:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788802212.807484:0:9483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 13:30:11 EDT 2026 00010000:00010000:1.0:1788802212.943187:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802213.261087:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802213.261110:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892131200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802213.261180:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802213.261272:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892131200 00000100:00100000:0.0:1788802213.261280:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892131200 00000100:00080000:2.0:1788802213.261346:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802213.263510:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788802213.263527:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892131200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802213.263627:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802213.263711:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892131200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802213.263718:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788802213.263770:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d0453e300 x1875694892131200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802213.263789:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892131200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788802213.964728:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802214.386595:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802214.386639:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802214.386675:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872174976 00000100:00100000:3.0:1788802214.386686:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872174976 00000100:00100000:3.0:1788802214.386742:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 203 00000100:00100000:3.0:1788802214.386754:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872174976:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802214.386819:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872174976:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 68us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802214.386826:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 203 00000100:00100000:3.0:1788802214.386955:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872175104 00000100:00100000:3.0:1788802214.386959:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872175104 00000100:00100000:3.0:1788802214.386993:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:3.0:1788802214.386999:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872175104:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802214.387043:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872175104:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 44us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802214.387049:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00080000:3.0:1788802214.387097:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788802214.999013:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802215.825789:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892131328:0@lo:400:kworker.0 00000100:00100000:1.0:1788802215.825903:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802215.826393:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892131328 00000100:00100000:2.0:1788802215.826405:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892131328 00000100:00100000:2.0:1788802215.826477:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788802215.826503:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892131328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802215.828740:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892131328:12345-0@lo:400:kworker.0 Request processed in 2238us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802215.828775:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788802215.829375:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892131328:0@lo:400:kworker.0 00000100:00100000:1.0:1788802215.829404:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802215.829430:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892131456:0@lo:400:kworker.0 00000100:00100000:1.0:1788802215.829581:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802215.830008:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892131456 00000100:00100000:2.0:1788802215.830019:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892131456 00000100:00100000:2.0:1788802215.830085:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788802215.830098:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892131456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802215.830177:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892131456:12345-0@lo:400:kworker.0 Request processed in 81us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802215.830184:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788802215.830219:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892131456:0@lo:400:kworker.0 00000100:00100000:2.0:1788802215.831663:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892131584:0@lo:400:kworker.0 00000100:00100000:2.0:1788802215.831747:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802215.834640:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892131584 00000100:00100000:3.0:1788802215.834665:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892131584 00000100:00100000:3.0:1788802215.834773:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788802215.834791:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892131584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802215.835618:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788802215.835640:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892131712:0@lo:400:kworker.0 00000100:00100000:2.0:1788802215.835736:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802215.835816:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892131712 00000100:00100000:2.0:1788802215.835823:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892131712 00000100:00100000:2.0:1788802215.835871:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788802215.835892:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892131712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802215.835939:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892131712:12345-0@lo:400:kworker.0 Request processed in 59us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802215.835945:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788802215.835995:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d0453d180 x1875694892131712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802215.836011:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892131712:0@lo:400:kworker.0 00000100:00100000:3.0:1788802215.837453:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892131584:12345-0@lo:400:kworker.0 Request processed in 2658us (5695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802215.837471:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788802215.837537:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788802215.837545:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802215.839069:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892131584:0@lo:400:kworker.0 00000100:00100000:0.0:1788802215.840132:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892131968:0@lo:400:kworker.0 00000100:00100000:0.0:1788802215.840222:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802215.840387:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788802215.840394:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892131840:0@lo:400:kworker.0 00000100:00100000:0.0:1788802215.840424:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802215.840468:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892131968 00000100:00100000:0.0:1788802215.840478:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892131968 00000100:00100000:0.0:1788802215.840637:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788802215.840648:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892131968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802215.840704:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892131968:12345-0@lo:400:kworker.0 Request processed in 59us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802215.840711:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788802215.840756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892131840 00000100:00100000:0.0:1788802215.840760:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892131840 00000100:00100000:0.0:1788802215.840788:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788802215.840793:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892131840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802215.840821:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892131840:12345-0@lo:400:kworker.0 Request processed in 28us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802215.840826:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788802215.840848:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788802215.840854:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788802215.840947:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892131840:0@lo:400:kworker.0 00010000:00080000:0.0:1788802215.840965:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d0453d180 x1875694892131968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802215.840975:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892131968:0@lo:400:kworker.0 00010000:00010000:1.0:1788802216.012727:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802216.332692:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788802216.332730:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892132096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802216.332837:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802216.333047:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892132096 00000100:00100000:1.0:1788802216.333058:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892132096 00000100:00100000:1.0:1788802216.333130:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788802216.333141:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892132096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802216.333189:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802216.333297:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892132096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802216.333305:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788802216.333434:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d063d7480 x1875694892132096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802216.333457:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892132096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788802217.036781:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802218.062368:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802218.385474:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788802218.385496:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892132224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802218.385568:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802218.385645:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892132224 00000100:00100000:2.0:1788802218.385657:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892132224 00000100:00100000:2.0:1788802218.385725:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788802218.385735:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892132224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788802218.385771:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802218.385817:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892132224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802218.385824:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788802218.385847:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788802218.385884:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d04541c00 x1875694892132224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802218.385905:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892132224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788802219.084539:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802219.510657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802219.510707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802219.510828:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872175360 00000100:00100000:2.0:1788802219.510842:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872175360 00000100:00080000:3.0:1788802219.510923:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802219.510929:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:2.0:1788802219.510941:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872175360:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802219.510969:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872175232 00000100:00100000:0.0:1788802219.510974:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872175232 00000100:00100000:2.0:1788802219.511022:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872175360:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 84us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802219.511029:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:0.0:1788802219.511214:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 205 00000100:00100000:0.0:1788802219.511258:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872175232:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802219.511287:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872175232:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 65us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802219.518834:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 205 00010000:00010000:3.0:1788802220.114416:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802220.941361:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892132608:0@lo:400:kworker.0 00000100:00100000:3.0:1788802220.941521:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892132352:0@lo:400:kworker.0 00000100:00100000:3.0:1788802220.941594:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802220.941642:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892132864:0@lo:400:kworker.0 00000100:00100000:3.0:1788802220.941667:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802220.941691:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788802220.941696:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892132480:0@lo:400:kworker.0 00000100:00100000:3.0:1788802220.941715:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802220.941728:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892132992:0@lo:400:kworker.0 00000100:00100000:3.0:1788802220.941748:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802220.941819:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892132992 00000100:00100000:3.0:1788802220.941827:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892132992 00000100:00100000:3.0:1788802220.941885:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788802220.941895:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892132992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802220.941948:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892132992:12345-0@lo:400:kworker.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802220.941954:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788802220.941975:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788802220.942017:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d063d7b80 x1875694892132992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802220.942030:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892132992:0@lo:400:kworker.0 00000100:00100000:1.0:1788802220.942325:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802220.942358:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788802220.942365:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892132736:0@lo:400:kworker.0 00000100:00100000:1.0:1788802220.942388:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802220.942575:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892132864 00000100:00100000:0.0:1788802220.942581:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892132864 00000100:00100000:0.0:1788802220.942629:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892132480 00000100:00100000:0.0:1788802220.942633:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892132480 00000100:00100000:0.0:1788802220.942646:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892132608 00000100:00100000:0.0:1788802220.942648:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892132608 00000100:00100000:0.0:1788802220.942663:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788802220.942670:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892132864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802220.942714:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892132864:12345-0@lo:400:kworker.0 Request processed in 45us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802220.942720:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788802220.942734:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788802220.942740:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892132480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802220.942781:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892132480:12345-0@lo:400:kworker.0 Request processed in 41us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802220.942787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788802220.942798:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788802220.942804:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892132608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802220.942838:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892132608:12345-0@lo:400:kworker.0 Request processed in 34us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802220.942856:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788802220.942878:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892132736 00000100:00100000:0.0:1788802220.942882:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892132736 00000100:00100000:0.0:1788802220.942908:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788802220.942914:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892132736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802220.942943:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892132736:12345-0@lo:400:kworker.0 Request processed in 30us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802220.942949:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788802220.942983:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d063d7100 x1875694892132736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802220.943006:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892132736:0@lo:400:kworker.0 00000100:00100000:0.0:1788802220.943019:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892132608:0@lo:400:kworker.0 00000100:00100000:0.0:1788802220.943045:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892132480:0@lo:400:kworker.0 00000100:00100000:0.0:1788802220.943054:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892132864:0@lo:400:kworker.0 00000100:00080000:1.0:1788802220.943687:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788802220.943694:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802220.943899:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892132352 00000100:00100000:2.0:1788802220.943906:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892132352 00000100:00100000:2.0:1788802220.943944:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788802220.943960:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892132352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802220.946047:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892132352:12345-0@lo:400:kworker.0 Request processed in 2080us (4445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802220.946061:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788802220.956006:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892132352:0@lo:400:kworker.0 00010000:00010000:1.0:1788802221.134089:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802221.454968:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892133120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802221.455039:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802221.457389:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892133120 00000100:00100000:2.0:1788802221.457404:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892133120 00000100:00100000:2.0:1788802221.457477:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788802221.457488:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892133120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802221.457529:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802221.458952:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892133120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1460us (3906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802221.458964:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788802221.459034:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d063d7480 x1875694892133120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802221.459059:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892133120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788802222.156552:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802223.183658:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802223.500565:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892133248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802223.500638:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802223.500695:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892133248 00000100:00100000:0.0:1788802223.500704:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892133248 00000100:00100000:0.0:1788802223.500770:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788802223.500779:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892133248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802223.500813:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788802223.500816:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802223.500870:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892133248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802223.500877:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788802223.500957:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d0453c700 x1875694892133248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802223.500975:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892133248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788802224.204553:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802224.628197:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802224.628310:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802224.628514:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872175488 00000100:00100000:2.0:1788802224.628525:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872175488 00000100:00100000:2.0:1788802224.628575:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 207 00000100:00100000:2.0:1788802224.628586:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872175488:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802224.628678:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872175488:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 94us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802224.628686:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 207 00000100:00100000:3.0:1788802224.630559:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872175616 00000100:00100000:3.0:1788802224.630572:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872175616 00000100:00100000:3.0:1788802224.630686:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:3.0:1788802224.630697:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872175616:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802224.630764:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872175616:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 70us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802224.630770:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00080000:2.0:1788802224.632204:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788802225.246365:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802226.063968:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892133376:0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064051:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802226.064106:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892133888:0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064141:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802226.064166:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788802226.064171:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892133504:0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064191:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802226.064207:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892134016:0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064229:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802226.064275:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892133632:0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064333:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802226.064351:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802226.064356:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892133760:0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064374:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802226.064401:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892133888 00000100:00100000:0.0:1788802226.064409:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892133888 00000100:00100000:0.0:1788802226.064455:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892133504 00000100:00100000:0.0:1788802226.064458:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892133504 00000100:00100000:0.0:1788802226.064471:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892133632 00000100:00100000:0.0:1788802226.064473:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892133632 00000100:00100000:0.0:1788802226.064487:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788802226.064495:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892133888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064545:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892133888:12345-0@lo:400:kworker.0 Request processed in 50us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802226.064553:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788802226.064569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788802226.064575:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892133504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064615:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892133504:12345-0@lo:400:kworker.0 Request processed in 40us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802226.064621:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788802226.064633:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788802226.064639:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892133632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064670:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892133632:12345-0@lo:400:kworker.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802226.064676:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788802226.064695:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892134016 00000100:00100000:0.0:1788802226.064699:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892134016 00000100:00100000:0.0:1788802226.064721:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892133760 00000100:00100000:0.0:1788802226.064723:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892133760 00000100:00100000:0.0:1788802226.064741:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788802226.064747:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892134016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064774:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892134016:12345-0@lo:400:kworker.0 Request processed in 28us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802226.064780:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788802226.064790:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788802226.064796:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892133760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064820:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892133760:12345-0@lo:400:kworker.0 Request processed in 25us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802226.064825:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788802226.064847:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788802226.064851:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788802226.064854:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788802226.064886:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a090e00 x1875694892133760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802226.064910:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892133760:0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064925:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892133632:0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064950:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892133504:0@lo:400:kworker.0 00010000:00080000:0.0:1788802226.064960:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a093b80 x1875694892134016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802226.064967:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892134016:0@lo:400:kworker.0 00000100:00100000:0.0:1788802226.064976:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892133888:0@lo:400:kworker.0 00000100:00100000:3.0:1788802226.065260:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892133376 00000100:00100000:3.0:1788802226.065264:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892133376 00000100:00100000:3.0:1788802226.065295:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788802226.065302:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892133376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802226.065352:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892133376:12345-0@lo:400:kworker.0 Request processed in 50us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802226.065367:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788802226.066858:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892133376:0@lo:400:kworker.0 00010000:00010000:3.0:1788802226.252505:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802226.572879:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788802226.572904:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892134144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788802226.572977:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802226.578489:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892134144 00000100:00100000:1.0:1788802226.578506:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892134144 00000100:00100000:1.0:1788802226.578600:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788802226.578610:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892134144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802226.578651:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802226.578746:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892134144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (5767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802226.578753:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788802226.580168:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d063d5180 x1875694892134144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802226.580193:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892134144:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788802227.276763:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788802228.188503:0:10113:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 13:30:26 (1788802226) === 00010000:00010000:1.0:1788802228.304715:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802228.522605:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802228.522808:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872175744 00000100:00100000:1.0:1788802228.522823:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872175744 00000100:00100000:1.0:1788802228.522900:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 209 00000100:00100000:1.0:1788802228.522913:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+10:8153:x1875694872175744:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788802228.522937:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802228.522963:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01681e00/0x6ecba1490fc9be17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edebbb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802228.523010:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01681e00/0x6ecba1490fc9be17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebbb expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802228.523024:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01681e00/0x6ecba1490fc9be17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebbb expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802228.523036:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01681e00, rc 0) 00000100:00100000:1.0:1788802228.523738:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+11:8153:x1875694872175744:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 822us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802228.523747:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 209 00000100:00100000:3.0:1788802228.530939:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802228.531040:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872175872 00000100:00100000:2.0:1788802228.531053:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872175872 00000100:00100000:1.0:1788802228.531225:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 210 00000100:00100000:1.0:1788802228.531274:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+11:8153:x1875694872175872:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788802228.531744:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+11:8153:x1875694872175872:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 508us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802228.531750:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 210 00000100:00100000:2.0:1788802228.540591:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802228.540703:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872176000 00000100:00100000:3.0:1788802228.540719:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872176000 00000100:00100000:3.0:1788802228.540794:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 211 00000100:00100000:3.0:1788802228.540807:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+11:8153:x1875694872176000:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788802228.541197:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+11:8153:x1875694872176000:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 392us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802228.541206:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 211 00000100:00100000:3.0:1788802228.547170:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802228.547574:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872176128 00000100:00100000:2.0:1788802228.547589:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872176128 00000100:00100000:1.0:1788802228.547813:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 212 00000100:00100000:1.0:1788802228.547830:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+11:8157:x1875694872176128:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788802228.548332:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+11:8157:x1875694872176128:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 506us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802228.548343:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 212 00000100:00100000:0.0:1788802228.568749:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802228.568864:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872176256 00000100:00100000:3.0:1788802228.568880:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872176256 00000100:00100000:3.0:1788802228.569347:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 213 00000100:00100000:3.0:1788802228.569372:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+11:8157:x1875694872176256:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788802228.569775:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+11:8157:x1875694872176256:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 415us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802228.569785:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 213 00000100:00100000:2.0:1788802228.577387:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802228.577498:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872176384 00000100:00100000:1.0:1788802228.577514:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872176384 00000100:00100000:1.0:1788802228.577744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 214 00000100:00100000:1.0:1788802228.577757:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+11:8153:x1875694872176384:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788802228.577782:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802228.577805:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01681400/0x6ecba1490fc9be1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edebe5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802228.577844:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01681400/0x6ecba1490fc9be1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebe5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802228.577855:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01681400/0x6ecba1490fc9be1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebe5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802228.577864:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01681400, rc 0) 00000100:00100000:1.0:1788802228.578332:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+12:8153:x1875694872176384:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 575us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802228.578340:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 214 00000100:00100000:0.0:1788802228.581622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802228.581728:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872176512 00000100:00100000:3.0:1788802228.581740:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872176512 00000100:00100000:3.0:1788802228.581795:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 215 00000100:00100000:3.0:1788802228.581802:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+12:8153:x1875694872176512:12345-192.168.201.57@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788802228.581830:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788802228.581859:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788802228.581862:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788802228.581868:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788802228.581870:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788802228.583561:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+12:8153:x1875694872176512:12345-192.168.201.57@tcp:256:mount.lustre.0 Request processed in 1748us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802228.583584:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 215 00000100:00100000:1.0:1788802228.586024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802228.586201:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872176640 00000100:00100000:3.0:1788802228.586215:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872176640 00000100:00100000:3.0:1788802228.586373:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 216 00000100:00100000:3.0:1788802228.586385:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+12:8153:x1875694872176640:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788802228.586406:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802228.586428:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee8000/0x6ecba1490fc9be25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edebec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802228.586470:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee8000/0x6ecba1490fc9be25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebec expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802228.586485:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee8000/0x6ecba1490fc9be25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebec expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802228.586495:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8000, rc 0) 00000100:00100000:3.0:1788802228.586559:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:8153:x1875694872176640:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 175us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802228.586566:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 216 00000100:00100000:0.0:1788802228.588989:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802228.589149:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872176768 00000100:00100000:3.0:1788802228.589163:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872176768 00000100:00100000:3.0:1788802228.589259:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 217 00000100:00100000:3.0:1788802228.589272:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:8153:x1875694872176768:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788802228.589684:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:8153:x1875694872176768:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 414us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802228.589701:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 217 00000100:00100000:0.0:1788802228.592626:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802228.592732:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872176896 00000100:00100000:3.0:1788802228.592750:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872176896 00000100:00100000:3.0:1788802228.592849:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 218 00000100:00100000:3.0:1788802228.592865:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:8153:x1875694872176896:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788802228.593895:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:8153:x1875694872176896:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 1024us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802228.593913:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 218 00000100:00100000:1.0:1788802228.596839:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802228.597098:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872177024 00000100:00100000:2.0:1788802228.597111:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872177024 00000100:00100000:2.0:1788802228.597217:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 219 00000100:00100000:2.0:1788802228.597227:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:8161:x1875694872177024:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788802228.597580:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:8161:x1875694872177024:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 353us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802228.597595:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 219 00000100:00100000:0.0:1788802228.605724:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802228.605955:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872177152 00000100:00100000:2.0:1788802228.605970:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872177152 00000100:00100000:2.0:1788802228.606105:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 220 00000100:00100000:2.0:1788802228.606127:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:8161:x1875694872177152:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788802228.606529:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:8161:x1875694872177152:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 412us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802228.606538:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 220 00000100:00100000:0.0:1788802228.616682:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802228.616737:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802228.616926:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872177280 00000100:00100000:3.0:1788802228.616941:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872177280 00000100:00100000:3.0:1788802228.617003:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872177664 00000100:00100000:3.0:1788802228.617007:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872177664 00000100:00100000:3.0:1788802228.617057:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:3.0:1788802228.617081:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872177664:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802228.617197:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872177664:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 130us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802228.617205:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:3.0:1788802228.617227:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788802228.617232:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1875694872177280:12345-192.168.201.57@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788802228.617286:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5d5134f2-023b-4d13-91da-559e8a611b5e@192.168.201.57@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:3.0:1788802228.617334:0:5843:0:(genops.c:1384:class_connect()) connect: client 5d5134f2-023b-4d13-91da-559e8a611b5e, cookie 0x6ecba1490fc9be2c 00000004:00100000:3.0:1788802228.617377:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788802228.617723:0:5843:0:(import.c:65:import_set_state_nolock()) ffff910d08d9a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802228.617762:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d5134f2-023b-4d13-91da-559e8a611b5e+6:2356:x1875694872177280:12345-192.168.201.57@tcp:38:mount.lustre.0 Request processed in 528us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802228.617770:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00080000:1.0:1788802228.618151:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802228.620650:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892134272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802228.620763:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802228.620884:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892134272 00000100:00100000:0.0:1788802228.620894:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892134272 00000100:00100000:0.0:1788802228.621000:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788802228.621011:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892134272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802228.621058:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802228.621154:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892134272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802228.621162:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788802228.621191:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802228.621226:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a6ad500 x1875694892134272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802228.621273:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892134272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802228.623173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802228.623309:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802228.623740:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872177536 00000100:00100000:0.0:1788802228.623754:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872177536 00000100:00100000:0.0:1788802228.623818:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872177408 00000100:00100000:0.0:1788802228.623821:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872177408 00000100:00100000:0.0:1788802228.623844:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788802228.623855:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+7:8153:x1875694872177536:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788802228.623906:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788802228.624027:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+7:8153:x1875694872177536:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 174us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802228.624035:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788802228.624053:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:0.0:1788802228.624059:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+6:0:x1875694872177408:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788802228.624106:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788802228.625483:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+6:0:x1875694872177408:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 1411us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802228.625498:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00080000:0.0:1788802228.625550:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802228.632556:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802228.633892:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872177792 00000100:00100000:1.0:1788802228.634103:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872177792 00000100:00100000:1.0:1788802228.634179:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788802228.634194:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+6:8153:x1875694872177792:12345-192.168.201.57@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788802228.634584:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+6:8153:x1875694872177792:12345-192.168.201.57@tcp:40:mount.lustre.0 Request processed in 393us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802228.634592:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788802228.637234:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802228.637384:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872177920 00000100:00100000:3.0:1788802228.637414:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872177920 00000100:00100000:3.0:1788802228.637472:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788802228.637483:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1875694872177920:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788802228.637525:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5d5134f2-023b-4d13-91da-559e8a611b5e@192.168.201.57@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:3.0:1788802228.637579:0:6690:0:(genops.c:1384:class_connect()) connect: client 5d5134f2-023b-4d13-91da-559e8a611b5e, cookie 0x6ecba1490fc9be33 00002000:00100000:3.0:1788802228.637594:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5d5134f2-023b-4d13-91da-559e8a611b5e/ffff910d08d9c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788802228.637610:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788802228.638301:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788802228.638346:0:6690:0:(import.c:65:import_set_state_nolock()) ffff910d08d9f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802228.641716:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+6:2356:x1875694872177920:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 4214us (4476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802228.641736:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:2.0:1788802228.646078:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802228.646293:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872178048 00000100:00100000:3.0:1788802228.646308:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872178048 00000100:00100000:3.0:1788802228.646371:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:3.0:1788802228.646383:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875694872178048:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788802228.646434:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5d5134f2-023b-4d13-91da-559e8a611b5e@192.168.201.57@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:3.0:1788802228.646483:0:6687:0:(genops.c:1384:class_connect()) connect: client 5d5134f2-023b-4d13-91da-559e8a611b5e, cookie 0x6ecba1490fc9be3a 00002000:00100000:3.0:1788802228.646500:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d5134f2-023b-4d13-91da-559e8a611b5e/ffff910d08d9f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788802228.646537:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788802228.646907:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788802228.646947:0:6687:0:(import.c:65:import_set_state_nolock()) ffff910d08d99000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802228.647037:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+6:2356:x1875694872178048:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 654us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802228.647046:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788802228.647911:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802228.648938:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872178176 00000100:00100000:3.0:1788802228.648954:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872178176 00000100:00100000:3.0:1788802228.649177:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:3.0:1788802228.649190:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+6:8153:x1875694872178176:12345-192.168.201.57@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788802228.649330:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788802228.649428:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+6:8153:x1875694872178176:12345-192.168.201.57@tcp:33:mount.lustre.0 Request processed in 240us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802228.649435:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000001:00100000:1.0:1788802228.726555:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d5134f2-023b-4d13-91da-559e8a611b5e 00010000:00010000:3.0:1788802229.324755:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802230.348417:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802231.184608:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892134528:0@lo:400:kworker.0 00000100:00100000:3.0:1788802231.184777:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802231.184845:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892135040:0@lo:400:kworker.0 00000100:00100000:3.0:1788802231.185046:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802231.185086:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788802231.185094:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892134400:0@lo:400:kworker.0 00000100:00100000:3.0:1788802231.185126:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802231.185151:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892134912:0@lo:400:kworker.0 00000100:00100000:3.0:1788802231.185175:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802231.185206:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892134656:0@lo:400:kworker.0 00000100:00100000:1.0:1788802231.186041:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892135040 00000100:00100000:1.0:1788802231.186057:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892135040 00000100:00100000:1.0:1788802231.186149:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788802231.186163:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892135040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802231.186806:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802231.186850:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788802231.187027:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892134784:0@lo:400:kworker.0 00000100:00100000:3.0:1788802231.187069:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802231.187113:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892134528 00000100:00100000:3.0:1788802231.187119:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892134528 00000100:00100000:3.0:1788802231.187160:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892134912 00000100:00100000:3.0:1788802231.187172:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892134912 00000100:00100000:3.0:1788802231.187192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892134656 00000100:00100000:3.0:1788802231.187194:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892134656 00000100:00100000:3.0:1788802231.187210:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788802231.187824:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892135040:12345-0@lo:400:kworker.0 Request processed in 1659us (2772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802231.187837:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788802231.188014:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892134784 00000100:00100000:1.0:1788802231.188028:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892134784 00000100:00100000:1.0:1788802231.188076:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788802231.188083:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892134784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802231.188140:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892134784:12345-0@lo:400:kworker.0 Request processed in 57us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802231.188146:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788802231.188170:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788802231.188176:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788802231.188190:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788802231.188206:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788802231.188215:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892134912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802231.188758:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892134528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802231.188805:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892134528:12345-0@lo:400:kworker.0 Request processed in 1588us (4029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802231.188813:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788802231.188834:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788802231.188842:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892134656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802231.189041:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892134656:12345-0@lo:400:kworker.0 Request processed in 199us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802231.189047:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788802231.189073:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892134400 00000100:00100000:3.0:1788802231.189079:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892134400 00000100:00100000:3.0:1788802231.189114:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788802231.189121:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892134400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802231.189155:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892134400:12345-0@lo:400:kworker.0 Request processed in 34us (4027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802231.189161:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788802231.189818:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892134912:12345-0@lo:400:kworker.0 Request processed in 1603us (4640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802231.189827:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788802231.189905:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892134400:0@lo:400:kworker.0 00000100:00100000:1.0:1788802231.189925:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892134912:0@lo:400:kworker.0 00000100:00100000:1.0:1788802231.189939:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892134528:0@lo:400:kworker.0 00010000:00080000:1.0:1788802231.190413:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a092680 x1875694892135040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802231.190427:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892135040:0@lo:400:kworker.0 00010000:00080000:1.0:1788802231.190486:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a092300 x1875694892134784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802231.190496:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892134784:0@lo:400:kworker.0 00000100:00100000:1.0:1788802231.190509:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892134656:0@lo:400:kworker.0 00010000:00010000:0.0:1788802231.372431:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802231.693420:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788802231.693452:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892135168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788802231.693554:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802231.693775:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892135168 00000100:00100000:1.0:1788802231.693786:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892135168 00000100:00100000:1.0:1788802231.693851:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788802231.693863:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892135168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802231.693908:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802231.693971:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892135168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802231.693998:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788802231.694084:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d063d5500 x1875694892135168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802231.694104:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892135168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788802232.396512:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788802233.327455:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d5134f2-023b-4d13-91da-559e8a611b5e 00010000:00010000:0.0:1788802233.423767:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802233.740451:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788802233.740609:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892135296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802233.740702:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802233.740866:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892135296 00000100:00100000:1.0:1788802233.740876:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892135296 00000100:00100000:1.0:1788802233.740966:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788802233.740986:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892135296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802233.740991:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788802233.741007:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788802233.741036:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802233.741096:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892135296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802233.741104:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788802233.741150:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a6ad500 x1875694892135296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788802233.741415:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788802233.741470:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892135296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802233.849328:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802233.849371:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802233.849398:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802233.849442:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802233.849467:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802233.849498:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872178304 00000100:00100000:3.0:1788802233.849512:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872178304 00000100:00100000:3.0:1788802233.849570:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 222 00000100:00100000:3.0:1788802233.849582:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872178304:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802233.849675:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872178304:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 95us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802233.849684:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 222 00000100:00100000:3.0:1788802233.849725:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872178560 00000100:00100000:3.0:1788802233.849730:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872178560 00000100:00100000:3.0:1788802233.849771:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872178432 00000100:00100000:3.0:1788802233.849774:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872178432 00000100:00100000:3.0:1788802233.849798:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:3.0:1788802233.849805:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872178560:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802233.849836:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872178560:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802233.849843:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:3.0:1788802233.849855:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:3.0:1788802233.849862:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872178432:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802233.849885:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872178432:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802233.849891:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:3.0:1788802233.850513:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872178816 00000100:00100000:3.0:1788802233.850521:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872178816 00000100:00100000:3.0:1788802233.850557:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872178688 00000100:00100000:3.0:1788802233.850570:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872178688 00000100:00100000:3.0:1788802233.850597:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:3.0:1788802233.850606:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+6:2359:x1875694872178816:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802233.850643:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+6:2359:x1875694872178816:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 39us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802233.850650:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:3.0:1788802233.850663:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788802233.850669:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872178688:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802233.850692:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872178688:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 23us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802233.850699:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00080000:3.0:1788802233.851314:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788802233.851321:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788802233.851325:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1788802233.868306:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d5134f2-023b-4d13-91da-559e8a611b5e 00000001:02000400:1.0:1788802234.264398:0:10309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788802234.444475:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802235.468528:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802236.305027:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892135680:0@lo:400:kworker.0 00000100:00100000:2.0:1788802236.305148:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802236.305286:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788802236.305294:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892135808:0@lo:400:kworker.0 00000100:00100000:2.0:1788802236.305356:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802236.305589:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892135424:0@lo:400:kworker.0 00000100:00100000:0.0:1788802236.305634:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802236.305680:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892135936:0@lo:400:kworker.0 00000100:00100000:0.0:1788802236.305705:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802236.305724:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788802236.305728:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892135552:0@lo:400:kworker.0 00000100:00100000:0.0:1788802236.305744:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802236.305755:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892136064:0@lo:400:kworker.0 00000100:00100000:0.0:1788802236.305772:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802236.305805:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892135680 00000100:00100000:0.0:1788802236.305839:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892135680 00000100:00100000:0.0:1788802236.305894:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892135936 00000100:00100000:0.0:1788802236.305896:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892135936 00000100:00100000:0.0:1788802236.305907:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892135552 00000100:00100000:0.0:1788802236.305908:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892135552 00000100:00100000:0.0:1788802236.305920:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788802236.305926:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892135680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802236.306016:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892135680:12345-0@lo:400:kworker.0 Request processed in 88us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802236.306024:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788802236.306050:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788802236.306056:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892135936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802236.306103:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892135936:12345-0@lo:400:kworker.0 Request processed in 48us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802236.306414:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788802236.306435:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788802236.306442:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892135552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802236.306487:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892135552:12345-0@lo:400:kworker.0 Request processed in 46us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802236.306492:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788802236.306524:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892135808 00000100:00100000:0.0:1788802236.306529:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892135808 00000100:00080000:1.0:1788802236.306554:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802236.306558:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892136064 00000100:00080000:1.0:1788802236.306560:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802236.306560:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892136064 00000100:00100000:1.0:1788802236.306610:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892135552:0@lo:400:kworker.0 00000100:00100000:1.0:1788802236.306625:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892135936:0@lo:400:kworker.0 00000100:00100000:3.0:1788802236.306731:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788802236.306746:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892135808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802236.306799:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892135808:12345-0@lo:400:kworker.0 Request processed in 62us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802236.306805:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788802236.307001:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d08c94a80 x1875694892135808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802236.307031:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892135808:0@lo:400:kworker.0 00000100:00100000:3.0:1788802236.307046:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892135680:0@lo:400:kworker.0 00000100:00100000:2.0:1788802236.311287:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892135424 00000100:00100000:2.0:1788802236.311310:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892135424 00000100:00100000:2.0:1788802236.311397:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788802236.311409:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892135424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802236.311539:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892135424:12345-0@lo:400:kworker.0 Request processed in 134us (5904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802236.311547:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788802236.311644:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892135424:0@lo:400:kworker.0 00000100:00100000:0.0:1788802236.311795:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788802236.311807:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892136064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802236.312003:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892136064:12345-0@lo:400:kworker.0 Request processed in 199us (6229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802236.312010:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788802236.313901:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788802236.315140:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d08c97800 x1875694892136064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802236.315165:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892136064:0@lo:400:kworker.0 00010000:00010000:0.0:1788802236.493213:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802236.817430:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788802236.817464:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892136192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802236.817608:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802236.827061:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892136192 00000100:00100000:1.0:1788802236.827083:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892136192 00000100:00100000:1.0:1788802236.827192:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788802236.827209:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892136192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802236.827293:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802236.827428:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892136192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 224us (9819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802236.827450:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788802236.827539:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d063d7100 x1875694892136192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802236.827565:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892136192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788802237.524586:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802238.541806:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802238.861486:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802238.861521:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892136320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802238.861620:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802238.861734:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892136320 00000100:00100000:0.0:1788802238.861743:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892136320 00000100:00100000:0.0:1788802238.861811:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788802238.861821:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892136320:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788802238.863232:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788802238.863857:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802238.863979:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892136320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2155us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802238.863988:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788802238.864808:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a92d80 x1875694892136320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802238.864965:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892136320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802238.961388:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802238.961433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802238.961478:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802238.961521:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802238.961550:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802238.961702:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872179456 00000100:00100000:1.0:1788802238.961716:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872179456 00000100:00100000:1.0:1788802238.961799:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872179328 00000100:00100000:1.0:1788802238.961803:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872179328 00000100:00100000:1.0:1788802238.961834:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:1.0:1788802238.961846:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d035b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872179456:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802238.961981:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d035b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872179456:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 137us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802238.961989:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:1.0:1788802238.962183:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:1.0:1788802238.962190:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872179328:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802238.962214:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872179328:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 25us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802238.962219:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:0.0:1788802238.962572:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872179200 00000100:00100000:0.0:1788802238.962578:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872179200 00000100:00100000:0.0:1788802238.962622:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872179072 00000100:00100000:0.0:1788802238.962626:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872179072 00000100:00100000:0.0:1788802238.962653:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:0.0:1788802238.962662:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872179200:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802238.962703:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872179200:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 43us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802238.962709:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:0.0:1788802238.962724:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:0.0:1788802238.962730:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872179072:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802238.962757:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872179072:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 27us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802238.962764:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00080000:2.0:1788802238.962880:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788802238.962912:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788802238.962914:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788802238.963069:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872178944 00000100:00100000:3.0:1788802238.963075:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872178944 00000100:00100000:3.0:1788802238.963158:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 224 00000100:00100000:3.0:1788802238.963165:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872178944:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802238.963196:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872178944:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 33us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802238.963202:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 224 00010000:00010000:0.0:1788802239.569970:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802240.589025:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802241.421198:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892136448:0@lo:400:kworker.0 00000100:00100000:2.0:1788802241.421465:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802241.421628:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892136448 00000100:00100000:0.0:1788802241.421640:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892136448 00000100:00100000:0.0:1788802241.421714:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788802241.421724:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892136448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802241.421942:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892136576:0@lo:400:kworker.0 00000100:00100000:1.0:1788802241.422005:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802241.422050:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892136576 00000100:00100000:1.0:1788802241.422054:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892136576 00000100:00100000:0.0:1788802241.422060:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892136448:12345-0@lo:400:kworker.0 Request processed in 338us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802241.422069:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788802241.422088:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788802241.422094:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892136576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802241.422131:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892136576:12345-0@lo:400:kworker.0 Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802241.422137:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788802241.422165:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892136576:0@lo:400:kworker.0 00000100:00100000:0.0:1788802241.422691:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892136832:0@lo:400:kworker.0 00000100:00100000:0.0:1788802241.422735:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802241.422766:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788802241.422773:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875694892136704:0@lo:400:kworker.0 00000100:00100000:0.0:1788802241.422860:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802241.423123:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892137088:0@lo:400:kworker.0 00000100:00100000:0.0:1788802241.423157:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802241.423186:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788802241.423192:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892136960:0@lo:400:kworker.0 00000100:00100000:0.0:1788802241.423215:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802241.423504:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892136832 00000100:00100000:3.0:1788802241.423610:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892136832 00000100:00100000:3.0:1788802241.423684:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892137088 00000100:00100000:3.0:1788802241.423687:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892137088 00000100:00100000:3.0:1788802241.423715:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788802241.423725:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892136832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802241.424079:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892136832:12345-0@lo:400:kworker.0 Request processed in 355us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802241.424089:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788802241.424110:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788802241.424118:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892137088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802241.424154:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892137088:12345-0@lo:400:kworker.0 Request processed in 39us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802241.424160:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788802241.424183:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892136704 00000100:00100000:3.0:1788802241.424187:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892136704 00000100:00100000:3.0:1788802241.424218:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892136960 00000100:00100000:3.0:1788802241.424221:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892136960 00000100:00100000:3.0:1788802241.424274:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788802241.424633:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788802241.424640:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788802241.424643:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802241.424726:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a093b80 x1875694892136832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802241.424744:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892136832:0@lo:400:kworker.0 00000100:00100000:0.0:1788802241.424787:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788802241.424870:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892136960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802241.424925:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892136960:12345-0@lo:400:kworker.0 Request processed in 131us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802241.424931:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788802241.424969:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892136960:0@lo:400:kworker.0 00010000:00080000:0.0:1788802241.424985:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a092680 x1875694892137088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802241.425012:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892137088:0@lo:400:kworker.0 00000100:00100000:3.0:1788802241.425084:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875694892136704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802241.425133:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875694892136704:12345-0@lo:400:kworker.0 Request processed in 55us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802241.425139:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788802241.425499:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875694892136704:0@lo:400:kworker.0 00000100:00100000:2.0:1788802241.425652:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892136448:0@lo:400:kworker.0 00010000:00010000:3.0:1788802241.615132:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802241.932745:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892137216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802241.932818:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802241.933052:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892137216 00000100:00100000:3.0:1788802241.933067:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892137216 00000100:00100000:3.0:1788802241.933138:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788802241.933146:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892137216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788802241.933189:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802241.933308:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892137216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802241.933317:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788802241.933386:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a091880 x1875694892137216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802241.933408:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892137216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788802242.642475:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802243.660542:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802243.980531:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892137344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802243.980599:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802243.980667:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892137344 00000100:00100000:1.0:1788802243.980675:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892137344 00000100:00100000:1.0:1788802243.980737:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788802243.980746:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892137344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788802243.980779:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802243.980828:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892137344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802243.980835:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788802243.980853:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788802243.981116:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d063d4e00 x1875694892137344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802243.981134:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892137344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802244.088614:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802244.088662:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802244.088673:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872179712 00000100:00100000:2.0:1788802244.088688:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872179712 00000100:00100000:3.0:1788802244.088694:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802244.088720:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802244.088746:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802244.088786:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872179968 00000100:00100000:3.0:1788802244.088807:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872179968 00000100:00100000:2.0:1788802244.088812:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872179840 00000100:00100000:2.0:1788802244.088819:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872179840 00000100:00100000:3.0:1788802244.088868:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872180096 00000100:00100000:3.0:1788802244.088874:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872180096 00000100:00100000:2.0:1788802244.088882:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:2.0:1788802244.088897:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872179712:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802244.088910:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:3.0:1788802244.088923:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872179968:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802244.089003:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872179712:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 107us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802244.089011:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872179968:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 85us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802244.089023:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788802244.089030:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:3.0:1788802244.089067:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:2.0:1788802244.089073:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:3.0:1788802244.089080:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872180096:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802244.089092:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872179840:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802244.089116:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872180096:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 38us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802244.089123:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:2.0:1788802244.089129:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872179840:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 41us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802244.089134:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:3.0:1788802244.089153:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872179584 00000100:00080000:2.0:1788802244.089158:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788802244.089161:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872179584 00000100:00080000:2.0:1788802244.089164:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788802244.089168:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802244.089205:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 226 00000100:00100000:3.0:1788802244.089214:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872179584:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802244.089288:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872179584:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 75us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802244.089297:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 226 00010000:00010000:3.0:1788802244.685106:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802245.711199:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802246.540597:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892137600:0@lo:400:kworker.0 00000100:00100000:0.0:1788802246.540635:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892137728:0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.540691:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892137472:0@lo:400:kworker.0 00000100:00100000:3.0:1788802246.553852:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802246.555875:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802246.555964:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892137984:0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.556018:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802246.556055:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892137600 00000100:00100000:1.0:1788802246.556066:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892137600 00000100:00100000:1.0:1788802246.556128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892137984 00000100:00100000:1.0:1788802246.556131:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892137984 00000100:00100000:0.0:1788802246.556252:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802246.556290:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892137728 00000100:00100000:0.0:1788802246.556294:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892137728 00000100:00100000:0.0:1788802246.556396:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788802246.556409:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892137600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.556533:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788802246.556540:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892137728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.556579:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892137728:12345-0@lo:400:kworker.0 Request processed in 39us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802246.556659:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788802246.556681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788802246.556687:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892137984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.556794:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892137984:12345-0@lo:400:kworker.0 Request processed in 32us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802246.556801:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788802246.556828:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892137472 00000100:00100000:1.0:1788802246.556833:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892137472 00000100:00100000:1.0:1788802246.556862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788802246.556869:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892137472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.556904:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892137472:12345-0@lo:400:kworker.0 Request processed in 35us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802246.556910:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1788802246.556942:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802246.556984:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892137984:0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.557015:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892137472:0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.557039:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802246.557048:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892138112:0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.557079:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802246.557105:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892138112 00000100:00100000:1.0:1788802246.557110:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892138112 00000100:00100000:1.0:1788802246.557149:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788802246.557385:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892138112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.557421:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892138112:12345-0@lo:400:kworker.0 Request processed in 39us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802246.557428:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788802246.557449:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788802246.557472:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a92680 x1875694892138112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802246.557484:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892138112:0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.558435:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892137856:0@lo:400:kworker.0 00000100:00100000:1.0:1788802246.558496:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802246.558847:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892137600:12345-0@lo:400:kworker.0 Request processed in 2439us (5004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802246.558859:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788802246.558917:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892137728:0@lo:400:kworker.0 00000100:00100000:2.0:1788802246.566968:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892137856 00000100:00100000:2.0:1788802246.566988:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892137856 00000100:00100000:2.0:1788802246.567075:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788802246.567088:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892137856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802246.567446:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892137856:12345-0@lo:400:kworker.0 Request processed in 361us (8948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802246.567454:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788802246.568071:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802246.568129:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a93480 x1875694892137856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802246.568148:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892137856:0@lo:400:kworker.0 00000100:00100000:3.0:1788802246.574858:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892137600:0@lo:400:kworker.0 00010000:00010000:0.0:1788802246.735410:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802247.052625:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802247.052657:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892138240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802247.052776:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802247.052858:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892138240 00000100:00100000:3.0:1788802247.052867:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892138240 00000100:00100000:3.0:1788802247.052952:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788802247.052964:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892138240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788802247.053010:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802247.053063:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892138240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802247.053071:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788802247.053120:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a093b80 x1875694892138240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802247.053142:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892138240:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788802247.757355:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802248.780685:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802249.100605:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802249.100634:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892138368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802249.100755:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802249.100783:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892138368 00000100:00100000:1.0:1788802249.100796:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892138368 00000100:00100000:1.0:1788802249.100862:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788802249.101108:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802249.101125:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892138368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802249.101173:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802249.101227:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892138368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 352us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802249.101235:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788802249.101303:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a93480 x1875694892138368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802249.101325:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892138368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802249.206506:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802249.206543:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802249.206680:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802249.206718:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802249.206746:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802249.206803:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872180608 00000100:00100000:2.0:1788802249.206813:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872180608 00000100:00100000:2.0:1788802249.206869:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872180736 00000100:00100000:2.0:1788802249.206872:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872180736 00000100:00100000:2.0:1788802249.206897:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:2.0:1788802249.206906:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2356:x1875694872180608:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:2.0:1788802249.206937:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9be33 00000100:00080000:2.0:1788802249.206946:0:6687:0:(import.c:65:import_set_state_nolock()) ffff910d08d9f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788802249.206986:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788802249.207384:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+2:2356:x1875694872180608:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 476us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802249.207393:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:2.0:1788802249.207410:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:2.0:1788802249.207419:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2356:x1875694872180736:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:2.0:1788802249.207431:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9be3a 00000100:00080000:2.0:1788802249.207437:0:6687:0:(import.c:65:import_set_state_nolock()) ffff910d08d99000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788802249.207457:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788802249.207653:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+2:2356:x1875694872180736:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 236us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802249.207660:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:2.0:1788802249.207681:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872180480 00000100:00100000:2.0:1788802249.207685:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872180480 00000100:00100000:2.0:1788802249.207723:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872180352 00000100:00100000:2.0:1788802249.207727:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872180352 00000100:00100000:2.0:1788802249.207747:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:2.0:1788802249.207753:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872180480:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802249.207784:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872180480:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 31us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802249.207798:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:2.0:1788802249.207812:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:2.0:1788802249.207818:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872180352:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802249.207845:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872180352:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 27us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802249.207850:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00080000:2.0:1788802249.207869:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788802249.207872:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802249.207874:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788802249.207888:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802249.208003:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802249.219750:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872180224 00000100:00100000:0.0:1788802249.219834:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872180224 00000100:00100000:0.0:1788802249.219933:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 228 00000100:00100000:0.0:1788802249.219944:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872180224:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802249.220021:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872180224:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 78us (13476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802249.220029:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 228 00010000:00010000:0.0:1788802249.811429:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802250.830459:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802251.662191:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892138752:0@lo:400:kworker.0 00000100:00100000:0.0:1788802251.662326:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802251.662415:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802251.662423:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892138880:0@lo:400:kworker.0 00000100:00100000:0.0:1788802251.662452:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802251.662498:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892138880 00000100:00100000:0.0:1788802251.662526:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892138880 00000100:00100000:0.0:1788802251.662600:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788802251.662610:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892138880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802251.662683:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892138880:12345-0@lo:400:kworker.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802251.662691:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788802251.662718:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802251.662757:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d08c94e00 x1875694892138880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802251.662774:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892138880:0@lo:400:kworker.0 00000100:00100000:3.0:1788802251.663030:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892138624:0@lo:400:kworker.0 00000100:00100000:3.0:1788802251.663070:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802251.663101:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892139136:0@lo:400:kworker.0 00000100:00100000:3.0:1788802251.663149:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802251.663181:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788802251.663188:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892138496:0@lo:400:kworker.0 00000100:00100000:3.0:1788802251.663219:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802251.663279:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892139008:0@lo:400:kworker.0 00000100:00100000:3.0:1788802251.663301:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802251.663332:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892139136 00000100:00100000:3.0:1788802251.663338:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892139136 00000100:00100000:3.0:1788802251.663382:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788802251.663390:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892139136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802251.663538:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892139136:12345-0@lo:400:kworker.0 Request processed in 148us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802251.663555:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788802251.663580:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892138496 00000100:00100000:3.0:1788802251.663585:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892138496 00000100:00100000:3.0:1788802251.663747:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788802251.663827:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892138496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802251.663861:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892138496:12345-0@lo:400:kworker.0 Request processed in 107us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802251.663868:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788802251.663897:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892138752 00000100:00100000:3.0:1788802251.663901:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892138752 00000100:00100000:3.0:1788802251.663988:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892138624 00000100:00100000:3.0:1788802251.663992:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892138624 00000100:00100000:2.0:1788802251.664618:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892139008 00000100:00100000:2.0:1788802251.664625:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892139008 00000100:00100000:2.0:1788802251.664667:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788802251.664677:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892138752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802251.664718:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788802251.664730:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892138624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802251.664783:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892138624:12345-0@lo:400:kworker.0 Request processed in 56us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802251.664789:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788802251.664804:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892138752:12345-0@lo:400:kworker.0 Request processed in 127us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802251.664809:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788802251.664817:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788802251.664821:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892139008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802251.664866:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892139008:12345-0@lo:400:kworker.0 Request processed in 48us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802251.664873:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788802251.665009:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788802251.665014:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788802251.665044:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892138496:0@lo:400:kworker.0 00000100:00100000:3.0:1788802251.665060:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892139008:0@lo:400:kworker.0 00000100:00100000:3.0:1788802251.665070:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892138624:0@lo:400:kworker.0 00010000:00080000:3.0:1788802251.665085:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d08c97b80 x1875694892139136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802251.665095:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892139136:0@lo:400:kworker.0 00000100:00100000:0.0:1788802251.667054:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892138752:0@lo:400:kworker.0 00010000:00010000:2.0:1788802251.854086:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802252.172554:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892139264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802252.172671:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802252.172916:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892139264 00000100:00100000:3.0:1788802252.172932:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892139264 00000100:00100000:3.0:1788802252.172996:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788802252.173008:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892139264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788802252.173057:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802252.173381:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892139264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 374us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802252.173390:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788802252.173459:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a620380 x1875694892139264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802252.173480:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892139264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788802252.877366:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788802253.766959:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d5134f2-023b-4d13-91da-559e8a611b5e 00000020:00000080:0.0:1788802253.766973:0:6714:0:(genops.c:885:class_export_put()) final put ffff910d08d9c800/5d5134f2-023b-4d13-91da-559e8a611b5e 00000020:00000080:0.0:1788802253.767010:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d08d9c800/5d5134f2-023b-4d13-91da-559e8a611b5e for lustre-OST0000 00000020:00000080:0.0:1788802253.767069:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d08d9f800 for lustre-OST0000 00010000:00010000:2.0:1788802253.901441:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788802254.053397:0:11009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788802254.223263:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892139392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802254.223373:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802254.223473:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892139392 00000100:00100000:0.0:1788802254.223483:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892139392 00000100:00100000:0.0:1788802254.223565:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788802254.223575:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892139392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802254.223702:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802254.223757:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892139392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802254.223765:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788802254.223790:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802254.223829:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a91f80 x1875694892139392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802254.223852:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892139392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802254.325798:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802254.325851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802254.325880:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802254.325922:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872181120 00000100:00100000:3.0:1788802254.325937:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872181120 00000100:00100000:3.0:1788802254.326018:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872180992 00000100:00100000:3.0:1788802254.326021:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872180992 00000100:00100000:3.0:1788802254.326052:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:1.0:1788802254.326376:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872180864 00000100:00100000:1.0:1788802254.326382:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872180864 00000100:00100000:3.0:1788802254.326392:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872181120:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802254.326412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 230 00000100:00100000:1.0:1788802254.326419:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872180864:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:2.0:1788802254.326485:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802254.326487:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872181120:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 101us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802254.326494:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:3.0:1788802254.326516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:3.0:1788802254.326522:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872180992:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802254.332384:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872180864:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 5945us (6584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802254.332405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 230 00000100:00100000:3.0:1788802254.337924:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872180992:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 11383us (12025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802254.337944:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 90 00000001:00100000:3.0:1788802254.379186:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d5134f2-023b-4d13-91da-559e8a611b5e 00000020:00000080:3.0:1788802254.379198:0:7635:0:(genops.c:885:class_export_put()) final put ffff910d08d9f000/5d5134f2-023b-4d13-91da-559e8a611b5e 00000020:00000080:3.0:1788802254.379235:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d08d9f000/5d5134f2-023b-4d13-91da-559e8a611b5e for lustre-OST0001 00000020:00000080:3.0:1788802254.379317:0:1386:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d08d99000 for lustre-OST0001 00010000:00010000:2.0:1788802254.926263:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802255.958235:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802256.782991:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892139648:0@lo:400:kworker.0 00000100:00100000:1.0:1788802256.783061:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802256.783106:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892140160:0@lo:400:kworker.0 00000100:00100000:1.0:1788802256.783132:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802256.783158:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788802256.783164:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892139520:0@lo:400:kworker.0 00000100:00100000:1.0:1788802256.783190:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802256.783211:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892140032:0@lo:400:kworker.0 00000100:00100000:1.0:1788802256.783232:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802256.783286:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892139520 00000100:00100000:1.0:1788802256.783294:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892139520 00000100:00100000:1.0:1788802256.783350:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788802256.783359:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892139520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802256.783409:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892139520:12345-0@lo:400:kworker.0 Request processed in 52us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802256.783626:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788802256.783681:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892139520:0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.784819:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892139776:0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.784872:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802256.784912:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802256.784919:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892139904:0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.784992:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802256.785027:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892139648 00000100:00100000:0.0:1788802256.785033:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892139648 00000100:00100000:0.0:1788802256.785070:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892140032 00000100:00100000:0.0:1788802256.785073:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892140032 00000100:00100000:0.0:1788802256.785095:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892139776 00000100:00100000:0.0:1788802256.785098:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892139776 00000100:00100000:0.0:1788802256.785115:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788802256.785123:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892139648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.785173:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892139648:12345-0@lo:400:kworker.0 Request processed in 51us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802256.785180:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788802256.785195:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788802256.785210:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892140032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.785266:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892140032:12345-0@lo:400:kworker.0 Request processed in 57us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802256.785272:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788802256.785284:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788802256.785302:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892139776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.785343:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892139776:12345-0@lo:400:kworker.0 Request processed in 42us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802256.785349:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788802256.785365:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892140160 00000100:00100000:0.0:1788802256.785369:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892140160 00000100:00100000:0.0:1788802256.785393:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892139904 00000100:00100000:0.0:1788802256.785395:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892139904 00000100:00100000:0.0:1788802256.785937:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788802256.785950:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892140160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.785989:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892140160:12345-0@lo:400:kworker.0 Request processed in 44us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802256.785996:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788802256.786011:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788802256.786016:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892139904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.786071:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892139904:12345-0@lo:400:kworker.0 Request processed in 55us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802256.786076:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788802256.786099:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788802256.786103:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788802256.786106:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788802256.786130:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3c700 x1875694892139904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802256.786150:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892139904:0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.786163:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892139776:0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.786202:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892140032:0@lo:400:kworker.0 00000100:00100000:0.0:1788802256.786212:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892139648:0@lo:400:kworker.0 00010000:00080000:0.0:1788802256.786221:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3ea00 x1875694892140160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802256.786229:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892140160:0@lo:400:kworker.0 00010000:00010000:0.0:1788802256.983091:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802257.313994:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892140288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802257.314108:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802257.315414:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892140288 00000100:00100000:2.0:1788802257.315431:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892140288 00000100:00100000:2.0:1788802257.315507:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788802257.315517:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892140288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802257.315571:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802257.315662:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892140288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802257.315671:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788802257.315920:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d08c94700 x1875694892140288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802257.317182:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892140288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788802258.001462:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788802258.197691:0:11157:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf2d8e980 20000000:00000080:2.0:1788802258.197712:0:11157:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910d33dce800 uarg=0000000000000000 20000000:01000000:2.0:1788802258.197752:0:11157:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788802258.197758:0:11157:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788802258.197763:0:11157:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788802258.215992:0:11158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788802258.216371:0:11157:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788802258.229337:0:11157:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788802258.229700:0:11157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.229731:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9bde6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebb4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.229742:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d00031000/0x6ecba1490fc9bdf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bded expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.229749:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bdfb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.229756:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d00031600/0x6ecba1490fc9be10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9be09 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.229764:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3eee8000/0x6ecba1490fc9be25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebec expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.229798:0:11157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.229863:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3eee8000/0x6ecba1490fc9be25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebec expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.229884:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d3eee8000/0x6ecba1490fc9be25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebec expref: 12 pid: 5836 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802258.229901:0:11157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875694892140416:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802258.230217:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d00031600/0x6ecba1490fc9be10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9be09 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.230227:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d00031600/0x6ecba1490fc9be10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9be09 expref: 18 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802258.230275:0:11157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c96680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875694892140544:0@lo:104: 00000100:00100000:2.0:1788802258.230326:0:11157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788802258.230380:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bdfb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.230390:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bdfb expref: 18 pid: 5836 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802258.230399:0:11157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875694892140672:0@lo:104: 00000100:00100000:2.0:1788802258.230424:0:11157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788802258.230459:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d00031000/0x6ecba1490fc9bdf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9bded expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.230561:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d00031000/0x6ecba1490fc9bdf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9bded expref: 18 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802258.230571:0:11157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875694892140800:0@lo:104: 00000100:00100000:1.0:1788802258.230647:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892140544 00000100:00100000:1.0:1788802258.230658:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892140544 00000100:00100000:1.0:1788802258.230713:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892140672 00000100:00100000:1.0:1788802258.230717:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892140672 00000100:00100000:1.0:1788802258.230733:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788802258.230743:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:11157:x1875694892140544:12345-0@lo:104: 00010000:00010000:1.0:1788802258.230759:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.230826:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788802258.230832:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:11157:x1875694892140544:12345-0@lo:104: Request processed in 90us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802258.230839:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788802258.230858:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788802258.230863:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:11157:x1875694892140672:12345-0@lo:104: 00010000:00010000:1.0:1788802258.230870:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.230898:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788802258.230901:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:11157:x1875694892140672:12345-0@lo:104: Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802258.230907:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788802258.230924:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788802258.230932:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.230950:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d00031e00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802258.230955:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.230964:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802258.230971:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802258.230977:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788802258.231018:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.231025:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802258.231046:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.231053:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d00031e00/0x6ecba1490fc9be09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be10 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.231071:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802258.231074:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.231080:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802258.231083:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.231101:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802258.231108:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802258.231114:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788802258.231133:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.231140:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802258.231157:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.231164:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9bdfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.231174:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802258.231177:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802258.231178:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802258.231194:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892141056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802258.231230:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802258.231299:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892141056 00000100:00100000:1.0:1788802258.231304:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892141056 00010000:00010000:1.0:1788802258.231323:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bdfb expref: 19 pid: 5836 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802258.231345:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788802258.231352:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892141056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802258.231371:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802258.231377:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bdfb expref: 19 pid: 5836 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.231388:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bdfb expref: 19 pid: 5836 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802258.231408:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802258.231435:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892141056:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802258.231441:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788802258.231507:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892141056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802258.232157:0:11157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788802258.232234:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9bde6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebb4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.232277:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9bde6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebb4 expref: 12 pid: 5837 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802258.232292:0:11157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875694892141184:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802258.232364:0:11157:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802258.232384:0:11157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c96680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875694892140544:0@lo:104: 00010000:00010000:2.0:1788802258.232395:0:11157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bdfb expref: 18 pid: 5836 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802258.232408:0:11157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875694892140672:0@lo:104: 00000100:00100000:0.0:1788802258.233969:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892140800 00000100:00100000:0.0:1788802258.233993:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892140800 00000100:00100000:0.0:1788802258.234065:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788802258.234077:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:11157:x1875694892140800:12345-0@lo:104: 00010000:00010000:0.0:1788802258.234099:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802258.234182:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788802258.234205:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892140928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788802258.234260:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788802258.234267:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:11157:x1875694892140800:12345-0@lo:104: Request processed in 193us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802258.234292:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788802258.234297:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802258.234331:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892140928 00000100:00100000:0.0:1788802258.234335:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892140928 00010000:00010000:2.0:1788802258.234352:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802258.234353:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d00031600/0x6ecba1490fc9be10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9be09 expref: 18 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.234358:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.234365:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ec00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:2.0:1788802258.234371:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802258.234376:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788802258.234382:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:3311:x1875694892140928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788802258.234386:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788802258.234394:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.234394:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802258.234400:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d00031600/0x6ecba1490fc9be10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9be09 expref: 18 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802258.234401:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788802258.234411:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d00031600/0x6ecba1490fc9be10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9be09 expref: 18 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.234428:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d00031600/0x6ecba1490fc9be10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9be09 expref: 18 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.234440:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.234446:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802258.234447:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802258.234471:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802258.234472:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:3311:x1875694892140928:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (175us total) trans 0 rc 0/0 00010000:00010000:2.0:1788802258.234479:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3f95ec00/0x6ecba1490fc9bded lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9bdf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802258.234479:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788802258.234494:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802258.234495:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802258.234497:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802258.234498:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802258.234514:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892141312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802258.234541:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802258.234612:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892140928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788802258.235194:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892141312 00000100:00100000:0.0:1788802258.235201:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892141312 00010000:00010000:0.0:1788802258.235225:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d00031000/0x6ecba1490fc9bdf4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bded expref: 17 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802258.235286:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788802258.235384:0:11157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875694892140800:0@lo:104: 00000100:00100000:0.0:1788802258.235440:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:3314:x1875694892141312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788802258.235452:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802258.235457:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d00031000/0x6ecba1490fc9bdf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9bded expref: 17 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.235476:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d00031000/0x6ecba1490fc9bdf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9bded expref: 17 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.235489:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d00031000/0x6ecba1490fc9bdf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9bded expref: 17 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.235502:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802258.235560:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3314:x1875694892141312:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802258.235624:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892141312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802258.239791:0:11157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875694892141184:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802258.240829:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788802258.244796:0:11157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875694892140416:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802258.244861:0:11157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802258.245358:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802258.245423:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802258.248268:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872181376 00000100:00100000:0.0:1788802258.248296:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872181376 00010000:00010000:0.0:1788802258.248372:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3eee8000/0x6ecba1490fc9be25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebec expref: 13 pid: 5836 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802258.248428:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872181248 00000100:00100000:0.0:1788802258.248432:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872181248 00010000:00010000:0.0:1788802258.248446:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9bde6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebb4 expref: 14 pid: 5837 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802258.248458:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:2.0:1788802258.248534:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a623480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f34e9515-dc55-4812-97ce-617e4dd802db+14:2359:x1875694872181376:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802258.248587:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802258.250261:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3eee8000/0x6ecba1490fc9be25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebec expref: 14 pid: 5836 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.250290:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3eee8000/0x6ecba1490fc9be25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebec expref: 14 pid: 5836 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.250315:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3eee8000/0x6ecba1490fc9be25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebec expref: 14 pid: 5836 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802258.250338:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802258.250449:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a623480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872181376:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 1977us (5092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802258.250856:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:0.0:1788802258.250892:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:0.0:1788802258.250928:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+12:2359:x1875694872181248:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788802258.250950:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802258.250967:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9bde6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebb4 expref: 12 pid: 5837 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.250979:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9bde6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebb4 expref: 12 pid: 5837 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.250991:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9bde6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edebb4 expref: 12 pid: 5837 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251005:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251016:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251037:0:7624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251046:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251053:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251061:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251068:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802258.251073:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251099:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251119:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251131:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802258.251170:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a621500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+11:2359:x1875694872181248:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 249us (5746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802258.251178:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00010000:00010000:0.0:1788802258.251207:0:11157:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251217:0:11157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802258.251224:0:11157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3f95f200/0x6ecba1490fc9be41 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802259.020406:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802259.342619:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892141440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802259.342728:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802259.342828:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892141440 00000100:00100000:3.0:1788802259.342838:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892141440 00000100:00100000:3.0:1788802259.342917:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788802259.342928:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892141440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788802259.342981:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802259.343037:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892141440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802259.343044:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788802259.343067:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788802259.343106:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a91500 x1875694892141440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802259.343128:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892141440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802259.441485:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802259.441545:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802259.441548:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872181632 00000100:00100000:0.0:1788802259.441559:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872181632 00000100:00100000:3.0:1788802259.441582:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802259.441599:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872181504 00000100:00100000:1.0:1788802259.441606:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872181504 00000100:00100000:3.0:1788802259.441616:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872181760 00000100:00100000:3.0:1788802259.441623:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872181760 00000100:00100000:1.0:1788802259.441643:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 232 00000100:00100000:0.0:1788802259.441643:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:0.0:1788802259.441654:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872181632:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:2.0:1788802259.441690:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802259.441741:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872181632:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 89us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802259.441896:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+11:2357:x1875694872181504:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802259.441961:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+11:2357:x1875694872181504:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 310us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802259.441969:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 232 00000100:00100000:0.0:1788802259.444893:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:0.0:1788802259.444926:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 95 00000100:00100000:0.0:1788802259.444944:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872181760:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802259.445044:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872181760:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 110us (3464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802259.445049:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 95 00000100:00100000:2.0:1788802259.762558:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802259.768708:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872181888 00000100:00100000:1.0:1788802259.768725:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872181888 00000100:00100000:1.0:1788802259.768790:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 233 00000100:00100000:1.0:1788802259.768802:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+11:5601:x1875694872181888:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802259.768818:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802259.768840:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01681000/0x6ecba1490fc9be48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edec16 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802259.768889:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01681000/0x6ecba1490fc9be48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec16 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802259.768903:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01681000/0x6ecba1490fc9be48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec16 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802259.768914:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01681000, rc 0) 00000100:00100000:1.0:1788802259.768993:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872181888:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 193us (6445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802259.769000:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 233 00000100:00100000:3.0:1788802259.774207:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802259.774346:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872182016 00000100:00100000:1.0:1788802259.774357:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872182016 00000100:00100000:1.0:1788802259.774422:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 234 00000100:00100000:1.0:1788802259.774433:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872182016:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802259.774780:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872182016:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 348us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802259.774789:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 234 00000100:00100000:3.0:1788802259.782812:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802259.782935:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872182144 00000100:00100000:1.0:1788802259.782945:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872182144 00000100:00100000:1.0:1788802259.783005:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 235 00000100:00100000:1.0:1788802259.783016:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872182144:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788802259.783265:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872182144:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 251us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802259.783273:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 235 00000100:00100000:2.0:1788802259.795723:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802259.796033:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872182272 00000100:00100000:3.0:1788802259.796044:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872182272 00000100:00100000:3.0:1788802259.796099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 236 00000100:00100000:3.0:1788802259.796108:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872182272:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802259.796125:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802259.796158:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee8a00/0x6ecba1490fc9be4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edec1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802259.796188:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee8a00/0x6ecba1490fc9be4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec1d expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802259.796200:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee8a00/0x6ecba1490fc9be4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec1d expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802259.796210:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8a00, rc 0) 00000100:00100000:3.0:1788802259.796324:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:5601:x1875694872182272:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 217us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802259.796331:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 236 00000100:00100000:0.0:1788802259.806108:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802259.806580:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872182400 00000100:00100000:3.0:1788802259.806591:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872182400 00000100:00100000:3.0:1788802259.806652:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 237 00000100:00100000:3.0:1788802259.806663:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:5601:x1875694872182400:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802259.806980:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:5601:x1875694872182400:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 317us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802259.806988:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 237 00000100:00100000:2.0:1788802259.810418:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802259.810567:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872182528 00000100:00100000:1.0:1788802259.810592:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872182528 00000100:00100000:1.0:1788802259.810645:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 238 00000100:00100000:1.0:1788802259.810656:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:5601:x1875694872182528:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788802259.810891:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:5601:x1875694872182528:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 236us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802259.810898:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 238 10000000:01000000:3.0:1788802259.981335:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788802259.981344:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d0450e000 from 7 10000000:01000000:3.0:1788802259.981349:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788802259.981459:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802259.981473:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802259.981500:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802259.981536:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a620e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892141568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788802259.981600:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802259.981648:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802259.982022:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892141568 00000100:00100000:2.0:1788802259.982030:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892141568 00000100:00100000:2.0:1788802259.982096:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788802259.982106:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892141568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802259.982127:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802259.982140:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3f95ec00/0x6ecba1490fc9be5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9be56 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802259.982164:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3f95ec00/0x6ecba1490fc9be5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9be56 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802259.982186:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3f95ec00/0x6ecba1490fc9be5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9be56 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802259.982195:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95ec00, rc 0) 00000100:00100000:2.0:1788802259.982268:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892141568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802259.982274:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788802259.982622:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a620e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892141568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802259.982636:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802259.982647:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802259.982701:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a620e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892141696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802259.982737:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802259.982763:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788802259.982955:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892141696 00000100:00100000:1.0:1788802259.982960:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892141696 00000100:00100000:1.0:1788802259.982991:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788802259.982998:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892141696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802259.983234:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892141696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802259.983265:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788802259.983562:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a620e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892141696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802259.983593:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a620e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892141824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802259.983630:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802259.983653:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802259.983726:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892141824 00000100:00100000:2.0:1788802259.983731:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892141824 00000100:00100000:2.0:1788802259.983762:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788802259.983769:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892141824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802259.984106:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892141824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 337us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802259.984329:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788802259.984379:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a620e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892141824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788802259.997400:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788802260.006581:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788802260.006618:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788802260.006630:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802260.006645:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802260.006658:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788802260.006661:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d1d17c800 from 7 10000000:01000000:2.0:1788802260.006664:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788802260.006709:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802260.007386:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802260.007399:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802260.007426:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892141952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788802260.007576:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802260.010416:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788802260.010604:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892141952 00000100:00100000:1.0:1788802260.010615:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892141952 00000100:00100000:1.0:1788802260.010680:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788802260.010690:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892141952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802260.010706:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802260.010734:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d01681600/0x6ecba1490fc9be6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9be64 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802260.010762:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d01681600/0x6ecba1490fc9be6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9be64 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802260.010773:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d01681600/0x6ecba1490fc9be6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9be64 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802260.010781:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01681600, rc 0) 00000100:00100000:1.0:1788802260.010847:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892141952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (3272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802260.010866:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788802260.010955:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892141952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802260.010970:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802260.010979:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802260.011052:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892142080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788802260.011082:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802260.011105:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788802260.011189:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892142080 00000100:00100000:1.0:1788802260.011193:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892142080 00000100:00100000:1.0:1788802260.011215:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788802260.011221:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892142080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802260.012709:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892142080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1480us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802260.012720:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788802260.013574:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892142080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788802260.013630:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892142208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802260.013683:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802260.013732:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788802260.013837:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892142208 00000100:00100000:3.0:1788802260.013845:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892142208 00000100:00100000:3.0:1788802260.013902:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788802260.013921:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892142208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802260.014461:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892142208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 540us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802260.014469:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788802260.014637:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892142208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788802260.019100:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788802260.019446:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788802260.019469:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788802260.019481:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802260.019494:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802260.019504:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788802260.019507:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d054ea800 from 7 10000000:01000000:3.0:1788802260.019509:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788802260.019557:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802260.019564:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802260.019576:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802260.019602:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a621f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892142336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788802260.019673:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802260.019720:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12553b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802260.019855:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892142336 00000100:00100000:2.0:1788802260.019864:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892142336 00000100:00100000:2.0:1788802260.019914:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788802260.019925:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892142336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802260.019939:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802260.019951:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9be72 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802260.019974:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9be72 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802260.019984:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9be72 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802260.019992:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95fc00, rc 0) 00000100:00100000:2.0:1788802260.020036:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892142336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802260.020043:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788802260.020088:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a621f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892142336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802260.020102:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802260.020838:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802260.021011:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892142464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788802260.021054:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802260.021150:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788802260.034963:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892142464 00000100:00100000:3.0:1788802260.034980:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892142464 00000100:00100000:3.0:1788802260.035040:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788802260.035051:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892142464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802260.035411:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892142464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (14356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802260.035419:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788802260.035996:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892142464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802260.036056:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892142592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802260.036126:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802260.036173:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d167b0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788802260.036385:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892142592 00000100:00100000:3.0:1788802260.036392:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892142592 00000100:00100000:3.0:1788802260.036433:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788802260.036451:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892142592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802260.036619:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892142592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802260.036626:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788802260.037010:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892142592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788802260.038538:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788802260.038635:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788802260.038657:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788802260.038668:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802260.038681:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802260.048456:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802261.069623:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802261.901015:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892142848:0@lo:400:kworker.0 00000100:00100000:1.0:1788802261.901099:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802261.901156:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892143360:0@lo:400:kworker.0 00000100:00100000:1.0:1788802261.901180:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802261.901223:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802261.901228:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892142976:0@lo:400:kworker.0 00000100:00100000:1.0:1788802261.901268:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802261.901300:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892142848 00000100:00100000:1.0:1788802261.901307:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892142848 00000100:00100000:1.0:1788802261.901363:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892142976 00000100:00100000:1.0:1788802261.901366:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892142976 00000100:00100000:1.0:1788802261.901392:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788802261.901401:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892142848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802261.901454:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892142848:12345-0@lo:400:kworker.0 Request processed in 53us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802261.901460:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788802261.901488:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788802261.901494:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892142976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802261.901520:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892142976:12345-0@lo:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802261.901525:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788802261.901543:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892143360 00000100:00100000:1.0:1788802261.901547:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892143360 00000100:00100000:1.0:1788802261.901573:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788802261.901579:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892143360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802261.901608:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892143360:12345-0@lo:400:kworker.0 Request processed in 29us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802261.901614:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788802261.901632:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788802261.901636:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802261.901667:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892142976:0@lo:400:kworker.0 00000100:00100000:1.0:1788802261.901677:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892142848:0@lo:400:kworker.0 00010000:00080000:1.0:1788802261.901688:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d063d7480 x1875694892143360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802261.901698:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892143360:0@lo:400:kworker.0 00000100:00100000:0.0:1788802261.901816:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892143104:0@lo:400:kworker.0 00000100:00100000:0.0:1788802261.901846:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802261.901875:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788802261.901880:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892142720:0@lo:400:kworker.0 00000100:00100000:0.0:1788802261.901906:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802261.901926:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892143232:0@lo:400:kworker.0 00000100:00100000:0.0:1788802261.901944:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802261.901965:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892143232 00000100:00100000:0.0:1788802261.901969:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892143232 00000100:00100000:0.0:1788802261.901995:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788802261.902000:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892143232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802261.902033:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892143232:12345-0@lo:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802261.902045:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788802261.902077:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d063d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892143232:0@lo:400:kworker.0 00000100:00100000:1.0:1788802261.902283:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892143104 00000100:00100000:1.0:1788802261.902287:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892143104 00000100:00100000:1.0:1788802261.902361:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788802261.902368:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892143104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802261.902404:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892143104:12345-0@lo:400:kworker.0 Request processed in 37us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802261.902410:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788802261.907562:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a18dc00 x1875694892143104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802261.907594:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892143104:0@lo:400:kworker.0 00000100:00100000:0.0:1788802261.907658:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892142720 00000100:00100000:0.0:1788802261.907667:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892142720 00000100:00100000:0.0:1788802261.910783:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788802261.910810:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892142720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802261.910938:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892142720:12345-0@lo:400:kworker.0 Request processed in 141us (9029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802261.910945:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:1.0:1788802261.911058:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788802261.911065:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802261.915100:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892142720:0@lo:400:kworker.0 00010000:00010000:1.0:1788802262.093894:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802262.418545:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892143488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802262.418620:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802262.418719:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892143488 00000100:00100000:1.0:1788802262.418727:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892143488 00000100:00100000:1.0:1788802262.418776:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788802262.418786:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892143488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802262.418821:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802262.418868:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892143488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802262.418875:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788802262.418916:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d08db8700 x1875694892143488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802262.418935:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892143488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788802263.117536:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788802263.433371:0:11357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788802264.146303:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802264.460588:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802264.460618:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892143616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802264.460931:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802264.469028:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892143616 00000100:00100000:3.0:1788802264.469053:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892143616 00000100:00100000:3.0:1788802264.469139:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788802264.469149:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892143616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788802264.469186:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802264.469288:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892143616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (8355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802264.469296:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788802264.469601:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a623b80 x1875694892143616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802264.469625:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892143616:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788802264.472060:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802264.575517:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802264.575565:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802264.575677:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802264.575735:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872182656 00000100:00100000:0.0:1788802264.575746:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872182656 00000100:00100000:0.0:1788802264.575810:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 249 00000100:00100000:0.0:1788802264.575821:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872182656:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802264.575895:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872182656:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 76us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802264.575903:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 249 00000100:00100000:1.0:1788802264.588920:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872182912 00000100:00100000:1.0:1788802264.588946:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872182912 00000100:00100000:1.0:1788802264.589059:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872182784 00000100:00100000:1.0:1788802264.589064:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872182784 00000100:00100000:1.0:1788802264.589101:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:1.0:1788802264.589112:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872182912:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802264.589217:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872182912:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 106us (13650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802264.589225:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:1.0:1788802264.589266:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:1.0:1788802264.589273:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872182784:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802264.589298:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872182784:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 26us (13622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802264.589304:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00080000:2.0:1788802264.589572:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788802265.166505:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802266.188713:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802267.020515:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892143872:0@lo:400:kworker.0 00000100:00100000:3.0:1788802267.020577:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802267.020634:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892144384:0@lo:400:kworker.0 00000100:00100000:3.0:1788802267.020659:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802267.020688:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788802267.020692:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892144000:0@lo:400:kworker.0 00000100:00100000:3.0:1788802267.020727:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802267.020753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892143872 00000100:00100000:3.0:1788802267.020759:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892143872 00000100:00100000:3.0:1788802267.020790:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892144000 00000100:00100000:3.0:1788802267.020792:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892144000 00000100:00100000:3.0:1788802267.020811:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788802267.020817:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892143872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802267.020856:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892143872:12345-0@lo:400:kworker.0 Request processed in 39us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802267.020861:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788802267.020872:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788802267.020876:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892144000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802267.020890:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892144000:12345-0@lo:400:kworker.0 Request processed in 14us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802267.020893:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788802267.020904:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892144384 00000100:00100000:3.0:1788802267.020906:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892144384 00000100:00100000:3.0:1788802267.020931:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788802267.020935:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892144384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802267.020954:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892144384:12345-0@lo:400:kworker.0 Request processed in 20us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802267.020958:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788802267.020991:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a622300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892144000:0@lo:400:kworker.0 00000100:00100000:3.0:1788802267.020998:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892143872:0@lo:400:kworker.0 00010000:00080000:3.0:1788802267.021005:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a621f80 x1875694892144384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802267.021011:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892144384:0@lo:400:kworker.0 00000100:00100000:2.0:1788802267.021132:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892144128:0@lo:400:kworker.0 00000100:00100000:2.0:1788802267.021155:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802267.021176:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788802267.021180:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892143744:0@lo:400:kworker.0 00000100:00100000:2.0:1788802267.021195:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802267.021207:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892144256:0@lo:400:kworker.0 00000100:00100000:2.0:1788802267.021218:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788802267.021230:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802267.021233:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802267.021364:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892144128 00000100:00100000:3.0:1788802267.021367:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892144128 00000100:00100000:3.0:1788802267.021413:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788802267.021419:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892144128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802267.021455:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892144128:12345-0@lo:400:kworker.0 Request processed in 37us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802267.021460:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788802267.021487:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a621880 x1875694892144128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802267.021494:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892144128:0@lo:400:kworker.0 00000100:00100000:3.0:1788802267.021504:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892144256 00000100:00100000:3.0:1788802267.021506:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892144256 00000100:00100000:3.0:1788802267.021521:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788802267.021524:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892144256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802267.021555:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892144256:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802267.021559:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788802267.021576:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a622a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892144256:0@lo:400:kworker.0 00000100:00080000:2.0:1788802267.021709:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788802267.021713:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802267.021876:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892143744 00000100:00100000:0.0:1788802267.021884:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892143744 00000100:00100000:0.0:1788802267.021911:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788802267.021916:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892143744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802267.021983:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892143744:12345-0@lo:400:kworker.0 Request processed in 68us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802267.021987:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788802267.024468:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892143744:0@lo:400:kworker.0 00010000:00010000:0.0:1788802267.212511:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802267.533642:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892144512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802267.533715:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802267.533820:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892144512 00000100:00100000:2.0:1788802267.533829:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892144512 00000100:00100000:2.0:1788802267.533885:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788802267.533896:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892144512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802267.533932:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802267.533979:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892144512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802267.533986:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788802267.534061:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d08db9f80 x1875694892144512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802267.534077:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892144512:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788802267.776704:0:11458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 13:31:06 (1788802266) === 00010000:00010000:1.0:1788802268.237173:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802268.262588:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802268.262703:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802268.262867:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872183168 00000100:00100000:1.0:1788802268.262878:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872183168 00000100:00100000:3.0:1788802268.262886:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872183040 00000100:00100000:3.0:1788802268.262893:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872183040 00000100:00100000:3.0:1788802268.262946:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:1.0:1788802268.262951:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788802268.262961:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872183040:12345-192.168.201.57@tcp:41:mkdir.0 00000100:00100000:1.0:1788802268.262966:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:9707:x1875694872183168:12345-192.168.201.57@tcp:700:mkdir.0 00000004:00000024:3.0:1788802268.263007:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788802268.263049:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:9707:x1875694872183168:12345-192.168.201.57@tcp:700:mkdir.0 Request processed in 89us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802268.263068:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788802268.263069:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872183040:12345-192.168.201.57@tcp:41:mkdir.0 Request processed in 111us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802268.263078:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00080000:2.0:1788802268.263355:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802268.268136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.271784:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872183424 00000100:00100000:3.0:1788802268.271807:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872183424 00000100:00100000:3.0:1788802268.271881:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788802268.271892:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:9707:x1875694872183424:12345-192.168.201.57@tcp:36:mkdir.0 00010000:00010000:3.0:1788802268.271959:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802268.272035:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bd61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb9f expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.272058:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02e21900) 00010000:00010000:3.0:1788802268.274629:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802268.275027:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be80 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.275043:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.275058:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.277378:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.277402:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.277416:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802268.279011:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788802268.279037:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.279054:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be80 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.279065:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.279074:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802268.279079:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.279285:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be80 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.279303:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02e21000) 00010000:00010000:3.0:1788802268.279306:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802268.279320:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be80 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.279637:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be80 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802268.279659:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5941f6c reply state 0000000027bebdc1 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802268.279668:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788802268.279779:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:9707:x1875694872183424:12345-192.168.201.57@tcp:36:mkdir.0 Request processed in 7885us (11647us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788802268.279788:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00010000:00010000:2.0:1788802268.282585:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.282598:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.282617:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.282621:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802268.282625:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.282630:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.282644:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff910d02e21800) 00010000:00010000:2.0:1788802268.282646:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802268.282649:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.282653:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9be87 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802268.305374:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.305478:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872183552 00000100:00100000:3.0:1788802268.305490:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872183552 00000100:00100000:3.0:1788802268.305557:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:3.0:1788802268.306304:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:9708:x1875694872183552:12345-192.168.201.57@tcp:101:chmod.0 00010000:00010000:3.0:1788802268.306333:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802268.306360:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec24 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.306439:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9be95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.306454:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9be95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.306467:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9be95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802268.306507:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788802268.306525:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802268.306773:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9be95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.306807:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9be8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec24 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.306826:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9be95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec24 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.306835:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02e21000) 00010000:00010000:3.0:1788802268.306838:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788802268.306841:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9200, rc 0) 00000100:00100000:2.0:1788802268.310512:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:9708:x1875694872183552:12345-192.168.201.57@tcp:101:chmod.0 Request processed in 4930us (5143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802268.310527:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:3.0:1788802268.314908:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802268.315051:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872183808 00000100:00100000:0.0:1788802268.315062:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872183808 00000100:00100000:0.0:1788802268.315158:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:0.0:1788802268.315168:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:9708:x1875694872183808:12345-192.168.201.57@tcp:36:chmod.0 00010000:00010000:0.0:1788802268.315222:0:9415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802268.315277:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9be95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec24 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.315297:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02e21000) 00010000:00010000:0.0:1788802268.315308:0:9415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788802268.315333:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.315347:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.315357:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788802268.315705:0:9415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6fa3d5f reply state 00000000cc02aa54 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802268.315722:0:9415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788802268.315732:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788802268.315877:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:9708:x1875694872183808:12345-192.168.201.57@tcp:36:chmod.0 Request processed in 709us (980us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788802268.315885:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00010000:00010000:3.0:1788802268.329674:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.329693:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.329706:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.329713:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802268.329717:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.329726:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.329744:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8600) 00010000:00010000:3.0:1788802268.329761:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788802268.329767:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.329773:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9be9c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802268.355887:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802268.356310:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872183936 00000100:00100000:0.0:1788802268.356322:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872183936 00000100:00100000:0.0:1788802268.356398:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:0.0:1788802268.356409:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:9709:x1875694872183936:12345-192.168.201.57@tcp:101:chown.0 00010000:00010000:0.0:1788802268.356563:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802268.356595:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9bea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec2b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.356668:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9beaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.356682:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9beaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.356693:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9beaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802268.356730:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788802268.356734:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802268.356775:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9beaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.356971:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9bea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec2b expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.357013:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9beaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec2b expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.357022:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802268.357025:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788802268.357029:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1600, rc 0) 00000100:00100000:0.0:1788802268.357159:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:9709:x1875694872183936:12345-192.168.201.57@tcp:101:chown.0 Request processed in 751us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802268.357167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:0.0:1788802268.362885:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.362960:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872184064 00000100:00100000:3.0:1788802268.362972:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872184064 00000100:00100000:3.0:1788802268.363032:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788802268.363042:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:9709:x1875694872184064:12345-192.168.201.57@tcp:101:chown.0 00010000:00010000:3.0:1788802268.363063:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802268.363083:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9beb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec32 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363147:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9beb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363162:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9beb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363173:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9beb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363190:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bebf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363197:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363203:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363356:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9bec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363375:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9bec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363383:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9bec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802268.363412:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788802268.363416:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802268.363437:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9bec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363665:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9beb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363672:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9beb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363678:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9beb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363685:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802268.363689:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9beb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363696:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9beb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363709:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8900) 00010000:00010000:3.0:1788802268.363720:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802268.363725:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9beb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363732:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9beb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363745:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363750:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363755:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363760:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802268.363762:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363767:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bebf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363774:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff910d02e21900) 00010000:00010000:3.0:1788802268.363776:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802268.363779:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bebf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363784:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bebf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363815:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9beb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec32 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363840:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9bec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec32 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.363847:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802268.363849:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788802268.363851:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9000, rc 0) 00000100:00100000:3.0:1788802268.363909:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:9709:x1875694872184064:12345-192.168.201.57@tcp:101:chown.0 Request processed in 868us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802268.363917:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:1.0:1788802268.368699:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802268.368791:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872184320 00000100:00100000:2.0:1788802268.368801:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872184320 00000100:00100000:2.0:1788802268.368859:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:2.0:1788802268.368867:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:9709:x1875694872184320:12345-192.168.201.57@tcp:36:chown.0 00010000:00010000:2.0:1788802268.368916:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802268.368941:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9bec6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec32 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.368978:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802268.368988:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802268.369011:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.369024:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.369033:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802268.405277:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6ff87a6 reply state 000000005331b897 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802268.405298:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788802268.405314:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788802268.405440:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:9709:x1875694872184320:12345-192.168.201.57@tcp:36:chown.0 Request processed in 36568us (36748us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788802268.405450:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000001:00080000:1.0:1788802268.406067:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1788802268.406094:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1788802268.406274:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.406286:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.406302:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.406309:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802268.406314:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.406322:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.406338:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d2166a900) 00010000:00010000:2.0:1788802268.406341:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788802268.412339:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.412414:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e400/0x6ecba1490fc9becd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802268.432616:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802268.432812:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872184448 00000100:00100000:0.0:1788802268.432823:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872184448 00000100:00100000:0.0:1788802268.432886:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788802268.432897:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:9710:x1875694872184448:12345-192.168.201.57@tcp:101:touch.500 00010000:00010000:0.0:1788802268.432924:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802268.432948:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9bed4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec39 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788802268.436726:0:9415:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3714us 00010000:00010000:0.0:1788802268.451287:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bedb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451312:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bedb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451324:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bedb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451353:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9bee2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451371:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9bee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451378:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9bee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451722:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9bee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451732:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9bee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451739:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9bee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802268.451763:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788802268.451767:0:9415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802268.451804:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9bee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451816:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bedb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451822:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bedb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451829:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bedb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451846:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802268.451849:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bedb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451856:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bedb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451869:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802268.451872:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802268.451876:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bedb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451882:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bedb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451892:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9bee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451897:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9bee2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451902:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9bee2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451906:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802268.451909:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9bee2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451914:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9bee2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451931:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff910d02db8100) 00010000:00010000:0.0:1788802268.451933:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802268.451936:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9bee2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451941:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9bee2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451983:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9bed4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec39 expref: 8 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.451997:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9bee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec39 expref: 7 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.452003:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02db8e00) 00010000:00010000:0.0:1788802268.452006:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788802268.452007:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0c00, rc 0) 00000100:00100000:0.0:1788802268.452091:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:9710:x1875694872184448:12345-192.168.201.57@tcp:101:touch.500 Request processed in 19196us (19488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802268.452101:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:1.0:1788802268.458919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.458982:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872184704 00000100:00100000:3.0:1788802268.458991:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872184704 00000100:00100000:3.0:1788802268.459044:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:3.0:1788802268.459054:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:9710:x1875694872184704:12345-192.168.201.57@tcp:101:touch.500 00010000:00010000:3.0:1788802268.459076:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802268.459095:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bef0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.459723:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bef7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.459748:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.459762:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.459775:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.459782:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.459788:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788802268.461587:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788802268.461915:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.461936:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.461950:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.461992:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.461999:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bef7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.462005:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bef7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.462023:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802268.462028:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bef7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.462036:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bef7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.462049:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02db8e00) 00010000:00010000:3.0:1788802268.462052:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802268.462057:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bef7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.462062:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bef7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802268.462075:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079fa98a6 reply state 000000008dfde581 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802268.462086:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788802268.462127:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bef0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec40 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.462141:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec40 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.462149:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff910d02e21100) 00010000:00010000:3.0:1788802268.462151:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788802268.462154:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8200, rc 0) 00000100:00100000:3.0:1788802268.463090:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:9710:x1875694872184704:12345-192.168.201.57@tcp:101:touch.500 Request processed in 4026us (4169us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788802268.463111:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00010000:00010000:3.0:1788802268.466616:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.466637:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.466645:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.466652:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802268.466656:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.466663:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.466681:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd82be10b (ffff910d02e21900) 00010000:00010000:3.0:1788802268.466685:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802268.466689:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.466695:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9befe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802268.470985:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.471337:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872184960 00000100:00100000:3.0:1788802268.471348:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872184960 00000100:00100000:3.0:1788802268.471413:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:3.0:1788802268.471424:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:9710:x1875694872184960:12345-192.168.201.57@tcp:36:touch.500 00010000:00010000:3.0:1788802268.471493:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802268.471539:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec40 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.471557:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff910d02e21100) 00010000:00010000:3.0:1788802268.471567:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802268.471608:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.471622:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.471634:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802268.471780:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000697bdd7b reply state 000000003327f480 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802268.471790:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788802268.471902:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:9710:x1875694872184960:12345-192.168.201.57@tcp:36:touch.500 Request processed in 479us (931us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788802268.471909:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00010000:00010000:2.0:1788802268.477489:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.477509:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.477518:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.477524:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802268.477530:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.477541:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.477573:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff910d02e21500) 00010000:00010000:2.0:1788802268.477577:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802268.477581:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.477588:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9bf13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802268.478156:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.478513:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872185088 00000100:00100000:3.0:1788802268.478527:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872185088 00000100:00100000:3.0:1788802268.478648:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:3.0:1788802268.478662:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:9710:x1875694872185088:12345-192.168.201.57@tcp:101:touch.500 00010000:00010000:3.0:1788802268.478687:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802268.478708:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.478781:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec47 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.478820:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec47 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.478843:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff910d02e21900) 00010000:00010000:3.0:1788802268.478846:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788802268.478853:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9600, rc 0) 00000100:00100000:3.0:1788802268.478920:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:9710:x1875694872185088:12345-192.168.201.57@tcp:101:touch.500 Request processed in 259us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802268.478930:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:1.0:1788802268.484980:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.485181:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872185216 00000100:00100000:3.0:1788802268.485193:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872185216 00000100:00100000:3.0:1788802268.485264:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:3.0:1788802268.485274:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875694872185216:12345-192.168.201.57@tcp:8:touch.500 00010000:00080000:3.0:1788802268.485322:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:3.0:1788802268.485357:0:6687:0:(genops.c:1384:class_connect()) connect: client df790e2a-6b5b-4b00-92e8-29e1cf7bde69, cookie 0x6ecba1490fc9bf21 00002000:00100000:3.0:1788802268.485378:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df790e2a-6b5b-4b00-92e8-29e1cf7bde69/ffff910d1d17a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788802268.485391:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788802268.485655:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788802268.485688:0:6687:0:(import.c:65:import_set_state_nolock()) ffff910d3efbf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802268.485758:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2356:x1875694872185216:12345-192.168.201.57@tcp:8:touch.500 Request processed in 484us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802268.485767:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:1.0:1788802268.491898:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.491988:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872185344 00000100:00100000:3.0:1788802268.491998:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872185344 00000100:00100000:3.0:1788802268.492086:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788802268.492096:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:0:x1875694872185344:12345-192.168.201.57@tcp:2:touch.500 00000100:00080000:2.0:1788802268.492596:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788802268.529686:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1788802268.529721:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000100:00100000:0.0:1788802268.530057:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:0:x1875694872185344:12345-192.168.201.57@tcp:2:touch.500 Request processed in 37955us (38163us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788802268.530071:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:2.0:1788802268.533061:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.533138:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872185600 00000100:00100000:3.0:1788802268.533150:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872185600 00000100:00100000:3.0:1788802268.533205:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:3.0:1788802268.533216:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:9710:x1875694872185600:12345-192.168.201.57@tcp:35:touch.500 00000100:00100000:3.0:1788802268.533792:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:9710:x1875694872185600:12345-192.168.201.57@tcp:35:touch.500 Request processed in 575us (737us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788802268.533802:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:2.0:1788802268.564780:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.564902:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872185728 00000100:00100000:3.0:1788802268.564914:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872185728 00000100:00100000:3.0:1788802268.564968:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:3.0:1788802268.564979:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:9711:x1875694872185728:12345-192.168.201.57@tcp:101:rm.0 00010000:00010000:3.0:1788802268.565004:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802268.565024:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec4e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.565096:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.565110:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.565121:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802268.565156:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788802268.565159:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802268.565212:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.565272:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec4e expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.565372:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec4e expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.565382:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02db8e00) 00010000:00010000:3.0:1788802268.565385:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788802268.565390:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8400, rc 0) 00000100:00100000:3.0:1788802268.565514:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:9711:x1875694872185728:12345-192.168.201.57@tcp:101:rm.0 Request processed in 535us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802268.565521:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:0.0:1788802268.573343:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.573559:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872185984 00000100:00100000:3.0:1788802268.573571:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872185984 00000100:00100000:3.0:1788802268.573641:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:3.0:1788802268.573652:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:9711:x1875694872185984:12345-192.168.201.57@tcp:101:rm.0 00010000:00010000:3.0:1788802268.573677:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802268.573700:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802268.573794:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788802268.573962:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec55 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.573976:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8900) 00010000:00010000:3.0:1788802268.573985:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788802268.573991:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec55 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.574004:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9400, rc 0) 00000100:00100000:3.0:1788802268.574075:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:9711:x1875694872185984:12345-192.168.201.57@tcp:101:rm.0 Request processed in 424us (744us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788802268.574081:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:2.0:1788802268.587115:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802268.587377:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872186112 00000100:00100000:0.0:1788802268.587452:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872186112 00000100:00100000:0.0:1788802268.587582:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:0.0:1788802268.587611:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:9711:x1875694872186112:12345-192.168.201.57@tcp:37:rm.0 00000100:00100000:0.0:1788802268.594649:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:9711:x1875694872186112:12345-192.168.201.57@tcp:37:rm.0 Request processed in 7024us (7533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802268.594667:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:1.0:1788802268.601886:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.602038:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872186368 00000100:00100000:3.0:1788802268.602055:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872186368 00000100:00100000:3.0:1788802268.602133:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:3.0:1788802268.602147:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:9711:x1875694872186368:12345-192.168.201.57@tcp:35:rm.0 00000100:00100000:3.0:1788802268.602550:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:9711:x1875694872186368:12345-192.168.201.57@tcp:35:rm.0 Request processed in 403us (689us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788802268.602569:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788802268.609802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.610043:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872186624 00000100:00100000:3.0:1788802268.610058:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872186624 00000100:00100000:3.0:1788802268.610193:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:3.0:1788802268.610207:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:9711:x1875694872186624:12345-192.168.201.57@tcp:101:rm.0 00010000:00010000:3.0:1788802268.610289:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802268.610318:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec5c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.610483:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.610504:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.610541:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802268.610555:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788802268.610806:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec5c expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.610832:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec5c expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.610843:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02db8e00) 00010000:00010000:3.0:1788802268.610847:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788802268.610851:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8200, rc 0) 00000100:00100000:3.0:1788802268.610956:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:9711:x1875694872186624:12345-192.168.201.57@tcp:101:rm.0 Request processed in 751us (1170us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788802268.610965:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:2.0:1788802268.622615:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.622798:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872186752 00000100:00100000:3.0:1788802268.622816:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872186752 00000100:00100000:3.0:1788802268.622900:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:3.0:1788802268.622914:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:9711:x1875694872186752:12345-192.168.201.57@tcp:41:rm.0 00000004:00000024:3.0:1788802268.623004:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788802268.623104:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:9711:x1875694872186752:12345-192.168.201.57@tcp:41:rm.0 Request processed in 192us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802268.623113:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:1.0:1788802268.631047:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802268.631179:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872186880 00000100:00100000:0.0:1788802268.631194:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872186880 00000100:00100000:0.0:1788802268.631309:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:0.0:1788802268.631323:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:9711:x1875694872186880:12345-192.168.201.57@tcp:101:rm.0 00010000:00010000:0.0:1788802268.631351:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802268.631388:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bf59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec63 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.631593:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9bf60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.631614:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9bf60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.631628:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9bf60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.631646:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9bf67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.631653:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9bf67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.631660:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9bf67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.631814:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9bf6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.631824:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9bf6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.631832:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9bf6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802268.631867:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788802268.632150:0:9415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802268.633032:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9bf6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633056:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9bf6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633067:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9bf60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633075:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9bf60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633084:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9bf60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633091:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802268.633096:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9bf60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633107:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9bf60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633122:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02db8e00) 00010000:00010000:2.0:1788802268.633126:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802268.633132:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9bf60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633159:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9bf60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633181:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9bf67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633187:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9bf67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633193:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9bf67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633197:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802268.633200:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9bf67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633206:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9bf67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633214:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd82be10b (ffff910d02db8100) 00010000:00010000:2.0:1788802268.633216:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802268.633219:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9bf67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.633225:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9bf67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.634030:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9bf59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec63 expref: 18 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.634053:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9bf6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec63 expref: 17 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.634075:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff910d02e21900) 00010000:00010000:2.0:1788802268.634078:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802268.634081:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1000, rc 0) 00000100:00100000:2.0:1788802268.634190:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:9711:x1875694872186880:12345-192.168.201.57@tcp:101:rm.0 Request processed in 2868us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802268.634201:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:2.0:1788802268.650670:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.650808:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872187136 00000100:00100000:3.0:1788802268.650825:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872187136 00000100:00100000:3.0:1788802268.650927:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:3.0:1788802268.650940:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:9711:x1875694872187136:12345-192.168.201.57@tcp:36:rm.0 00010000:00010000:3.0:1788802268.651017:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788802268.651058:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9bf6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec63 expref: 17 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651088:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec47 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651101:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff910d02e21900) 00010000:00010000:3.0:1788802268.651122:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec4e expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651130:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02db8e00) 00010000:00010000:3.0:1788802268.651133:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802268.651159:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651177:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651188:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651204:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651211:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651230:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651540:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9bf83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651549:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9bf83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.651557:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9bf83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788802268.656116:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788802268.656149:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321602909369ns, next at 322602903684ns, rc = 0 00010000:00010000:2.0:1788802268.656734:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656758:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656775:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656786:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656792:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656799:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656876:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788802268.656905:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9bf83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656931:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9bf83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656938:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9bf83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656945:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802268.656951:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9bf83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656959:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9bf83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656974:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff910d02e21500) 00010000:00010000:2.0:1788802268.656977:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788802268.656984:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9bf83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.656989:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9bf83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.657013:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.657019:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.657024:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.657028:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802268.657038:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.657044:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.657051:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02db8e00) 00010000:00010000:2.0:1788802268.657054:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802268.657057:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.657062:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9bf75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802268.657073:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000f3a696 reply state 00000000f17a804a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802268.657084:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788802268.657231:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:9711:x1875694872187136:12345-192.168.201.57@tcp:36:rm.0 Request processed in 6288us (6573us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788802268.657273:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 30 00010000:00010000:3.0:1788802268.662452:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.662469:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.662477:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.662482:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802268.662487:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.662494:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.662512:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd82be10b (ffff910d02e21100) 00010000:00010000:3.0:1788802268.662515:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802268.662520:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.662545:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.668383:0:6703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802268.668911:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.668930:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e000 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802268.668937:0:6703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.668952:0:6703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.668982:0:6703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff910d02e21500) 00010000:00010000:0.0:1788802268.668986:0:6703:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788802268.668992:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.669000:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9bf8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802268.669328:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802268.669354:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802268.669357:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802268.672376:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.672854:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872187392 00000100:00100000:3.0:1788802268.672871:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872187392 00000100:00100000:3.0:1788802268.672938:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:3.0:1788802268.672955:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:9711:x1875694872187392:12345-192.168.201.57@tcp:35:rm.0 00000100:00100000:3.0:1788802268.673209:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:9711:x1875694872187392:12345-192.168.201.57@tcp:35:rm.0 Request processed in 259us (859us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788802268.673216:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:2.0:1788802268.675953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802268.679001:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872187648 00000100:00100000:3.0:1788802268.679024:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872187648 00000100:00100000:3.0:1788802268.679194:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:3.0:1788802268.679207:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:9711:x1875694872187648:12345-192.168.201.57@tcp:36:rm.0 00010000:00010000:3.0:1788802268.679326:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788802268.679375:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8200/0x6ecba1490fc9bf4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec5c expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679405:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9bee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec39 expref: 15 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679419:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02db8e00) 00010000:00010000:3.0:1788802268.679439:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9beaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec2b expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679449:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8900) 00010000:00010000:3.0:1788802268.679475:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802268.679506:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf91 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679522:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679540:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679554:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679561:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679568:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679906:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679916:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.679923:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802268.680682:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788802268.680705:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680714:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680729:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680735:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802268.680741:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680750:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680762:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802268.680766:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788802268.680772:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680778:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9600/0x6ecba1490fc9bf9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680805:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680812:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf91 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680818:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680823:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802268.680826:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680843:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf91 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680852:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02e21100) 00010000:00010000:3.0:1788802268.680854:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802268.680857:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf91 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802268.680863:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9bf91 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802268.680875:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072d16b60 reply state 000000002f083fda transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802268.680887:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788802268.681020:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:9711:x1875694872187648:12345-192.168.201.57@tcp:36:rm.0 Request processed in 1811us (5150us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788802268.681030:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00010000:00010000:2.0:1788802268.692041:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.692065:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.692074:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.692102:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802268.692108:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.692117:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.692138:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff910d02e21900) 00010000:00010000:2.0:1788802268.692141:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802268.692148:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802268.692155:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9bf98 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802269.262052:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802269.580585:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802269.580617:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892144640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802269.580722:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802269.580817:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892144640 00000100:00100000:3.0:1788802269.580827:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892144640 00000100:00100000:3.0:1788802269.580899:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788802269.580909:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892144640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788802269.580956:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802269.581013:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892144640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802269.581034:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788802269.581059:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788802269.581098:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d33d9c700 x1875694892144640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802269.581119:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892144640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802269.689479:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802269.689523:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802269.689569:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802269.689601:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802269.689639:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872187904 00000100:00100000:3.0:1788802269.689652:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872187904 00000100:00100000:3.0:1788802269.689716:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872188160 00000100:00100000:3.0:1788802269.689720:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872188160 00000100:00100000:3.0:1788802269.689759:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:3.0:1788802269.689772:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:2360:x1875694872187904:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802269.689880:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:2360:x1875694872187904:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 110us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802269.689889:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:3.0:1788802269.689909:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 105 00000100:00100000:3.0:1788802269.689916:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872188160:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802269.689943:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872188160:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802269.689949:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 105 00000100:00100000:3.0:1788802269.689973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872187776 00000100:00100000:3.0:1788802269.689978:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872187776 00000100:00100000:3.0:1788802269.690024:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 251 00000100:00100000:3.0:1788802269.690031:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872187776:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802269.690062:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872187776:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 32us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802269.690069:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 251 00000100:00100000:3.0:1788802269.690101:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872188032 00000100:00100000:3.0:1788802269.690104:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872188032 00000100:00100000:3.0:1788802269.690134:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:3.0:1788802269.690141:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872188032:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802269.690167:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872188032:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802269.690175:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00080000:3.0:1788802269.690196:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788802270.288183:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802271.308532:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802272.141337:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892145024:0@lo:400:kworker.0 00000100:00100000:0.0:1788802272.141410:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802272.141487:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788802272.141494:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892144896:0@lo:400:kworker.0 00000100:00100000:0.0:1788802272.141516:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802272.141534:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892145408:0@lo:400:kworker.0 00000100:00100000:0.0:1788802272.141555:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802272.141588:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892145024 00000100:00100000:0.0:1788802272.141596:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892145024 00000100:00100000:0.0:1788802272.141655:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892144896 00000100:00100000:0.0:1788802272.141659:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892144896 00000100:00100000:0.0:1788802272.141681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788802272.141691:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892145024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802272.141744:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892145024:12345-0@lo:400:kworker.0 Request processed in 55us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802272.141752:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788802272.141767:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788802272.141774:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892144896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802272.141800:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892144896:12345-0@lo:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802272.141805:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1788802272.141824:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802272.141872:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892144896:0@lo:400:kworker.0 00000100:00100000:0.0:1788802272.141884:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892145024:0@lo:400:kworker.0 00000100:00100000:3.0:1788802272.142274:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892144768:0@lo:400:kworker.0 00000100:00100000:3.0:1788802272.142325:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802272.142360:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3faead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892145280:0@lo:400:kworker.0 00000100:00100000:3.0:1788802272.142381:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802272.142406:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802272.142412:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892145152:0@lo:400:kworker.0 00000100:00100000:3.0:1788802272.142435:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802272.142503:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892145280 00000100:00100000:2.0:1788802272.142508:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892145280 00000100:00100000:2.0:1788802272.142552:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788802272.142559:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892145280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802272.142599:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892145280:12345-0@lo:400:kworker.0 Request processed in 40us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802272.142606:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1788802272.142746:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802272.142769:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3faead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892145280:0@lo:400:kworker.0 00000100:00100000:0.0:1788802272.142922:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892144768 00000100:00100000:0.0:1788802272.142927:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892144768 00000100:00100000:1.0:1788802272.143041:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892145408 00000100:00100000:1.0:1788802272.143047:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892145408 00000100:00100000:1.0:1788802272.143090:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892145152 00000100:00100000:1.0:1788802272.143092:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892145152 00000100:00100000:1.0:1788802272.143121:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788802272.143127:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892145408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802272.143170:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892145408:12345-0@lo:400:kworker.0 Request processed in 44us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802272.143176:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788802272.143189:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788802272.143194:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892145152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802272.143267:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892145152:12345-0@lo:400:kworker.0 Request processed in 73us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802272.143284:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788802272.143332:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3c700 x1875694892145152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802272.143343:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892145152:0@lo:400:kworker.0 00010000:00080000:1.0:1788802272.143395:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fae8a80 x1875694892145408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802272.143405:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892145408:0@lo:400:kworker.0 00000100:00100000:0.0:1788802272.143644:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788802272.143654:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3312:x1875694892144768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802272.143702:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3312:x1875694892144768:12345-0@lo:400:kworker.0 Request processed in 51us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802272.143708:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788802272.143768:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892144768:0@lo:400:kworker.0 00000100:00080000:2.0:1788802272.143831:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788802272.143835:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788802272.332762:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788802272.654452:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325601209882ns, next at 326601207428ns, rc = 0 00000100:00100000:1.0:1788802272.654532:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892145536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802272.654623:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802272.654790:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892145536 00000100:00100000:2.0:1788802272.654799:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892145536 00000100:00100000:2.0:1788802272.654865:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788802272.654878:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892145536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802272.654934:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802272.654987:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892145536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802272.654995:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788802272.655078:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d08db9c00 x1875694892145536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802272.655099:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892145536:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788802273.345634:0:11608:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788802273.356689:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788802273.774931:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788802273.774969:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788802273.774978:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788802273.775211:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892145664:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788802273.775401:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802273.775497:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892145664 00000100:00100000:0.0:1788802273.775831:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892145664 00000100:00100000:0.0:1788802273.775941:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788802273.775953:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892145664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788802273.775986:0:8127:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788802273.776024:0:8127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ef4dc, atime: 0x6a9ef4dc, ctime: 0x6a9ef4dc, blocks: 0x1 00010000:00010000:0.0:1788802273.776032:0:8127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b6828a3/0x6ecba1490fc9bfa6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802273.776049:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1788802273.776053:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802273.776060:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b6828a3/0x6ecba1490fc9bfa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802273.776095:0:8127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b6828a3/0x6ecba1490fc9bfa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802273.776108:0:8127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b6828a3/0x6ecba1490fc9bfa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802273.776115:0:8127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b6828a3/0x6ecba1490fc9bfa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802273.776135:0:8127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788802273.777500:0:6703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802273.777523:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b6828a3/0x6ecba1490fc9bfa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802273.777664:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802273.777670:0:6703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b6828a3/0x6ecba1490fc9bfa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802273.777681:0:6703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b6828a3/0x6ecba1490fc9bfa6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802273.777706:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b6828a3/0x6ecba1490fc9bfa6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802273.777715:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b6828a3/0x6ecba1490fc9bfa6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802273.777739:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802273.777741:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802273.777743:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802273.779972:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892145664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4011us (4560us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788802273.779986:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788802273.780127:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d3fae9880/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788802273.780134:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892145664:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788802274.380676:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788802274.395954:0:11658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6aefeaa0 20000000:00000080:3.0:1788802274.395973:0:11658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910d3fc2c800 uarg=0000000000000000 20000000:01000000:3.0:1788802274.396011:0:11658:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788802274.396017:0:11658:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788802274.396022:0:11658:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788802274.397637:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788802274.397830:0:11658:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788802274.402891:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788802274.402953:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788802274.403009:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788802274.403027:0:11658:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788802274.403049:0:11658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403069:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d01681000/0x6ecba1490fc9be48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec16 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403076:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3eee8a00/0x6ecba1490fc9be4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec1d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403083:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3f95ec00/0x6ecba1490fc9be5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9be56 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403088:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d01681600/0x6ecba1490fc9be6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9be64 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403095:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9be72 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403102:0:11658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403151:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9be72 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403169:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9be72 expref: 18 pid: 5837 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802274.403185:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875694892145792:0@lo:104: 00000100:00100000:3.0:1788802274.403503:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788802274.403601:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d01681600/0x6ecba1490fc9be6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9be64 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403610:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d01681600/0x6ecba1490fc9be6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9be64 expref: 18 pid: 5837 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802274.403619:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875694892145920:0@lo:104: 00000100:00100000:3.0:1788802274.403642:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788802274.403665:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3f95ec00/0x6ecba1490fc9be5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9be56 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403672:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff910d3f95ec00/0x6ecba1490fc9be5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9be56 expref: 18 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802274.403679:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875694892146048:0@lo:104: 00000100:00100000:3.0:1788802274.403698:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788802274.403714:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3eee8a00/0x6ecba1490fc9be4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec1d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403724:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d3eee8a00/0x6ecba1490fc9be4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec1d expref: 12 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802274.403746:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875694892146176:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802274.403975:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d01681000/0x6ecba1490fc9be48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec16 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802274.403984:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d01681000/0x6ecba1490fc9be48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec16 expref: 12 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802274.403992:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875694892146304:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802274.404020:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802274.405078:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788802274.405103:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892145792 00000100:00100000:1.0:1788802274.405112:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892145792 00000100:00100000:1.0:1788802274.405153:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892145920 00000100:00100000:1.0:1788802274.405155:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892145920 00000100:00100000:1.0:1788802274.405164:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892146048 00000100:00100000:1.0:1788802274.405166:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892146048 00000100:00100000:1.0:1788802274.405180:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788802274.405203:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:11658:x1875694892145792:12345-0@lo:104: 00010000:00010000:1.0:1788802274.405232:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405360:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788802274.405367:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+5:11658:x1875694892145792:12345-0@lo:104: Request processed in 179us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802274.405373:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788802274.405392:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788802274.405398:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:11658:x1875694892145920:12345-0@lo:104: 00010000:00010000:1.0:1788802274.405405:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405441:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788802274.405446:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+4:11658:x1875694892145920:12345-0@lo:104: Request processed in 49us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802274.405452:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788802274.405475:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788802274.405481:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:11658:x1875694892146048:12345-0@lo:104: 00010000:00010000:1.0:1788802274.405488:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405519:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788802274.405523:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+3:11658:x1875694892146048:12345-0@lo:104: Request processed in 44us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802274.405529:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788802274.405566:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788802274.405572:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405586:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9a00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802274.405592:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405600:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802274.405607:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802274.405612:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788802274.405647:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405655:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802274.405677:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405684:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3eee9a00/0x6ecba1490fc9be72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405698:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788802274.405701:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405707:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f600 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802274.405709:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405727:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802274.405733:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802274.405738:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788802274.405753:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405758:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802274.405774:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405780:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3f95f600/0x6ecba1490fc9be64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be6b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405789:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802274.405792:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405796:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8e00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802274.405799:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405804:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802274.405809:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802274.405820:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788802274.405832:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405837:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802274.405843:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405849:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9be56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9be5d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.405864:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802274.405867:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802274.405869:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802274.405875:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802274.405881:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802274.405902:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892146432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802274.405935:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802274.405984:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892146560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802274.406007:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802274.406027:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802274.406033:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892146688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802274.406055:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802274.406081:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892146432 00000100:00100000:1.0:1788802274.406086:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892146432 00010000:00010000:1.0:1788802274.406109:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9be72 expref: 19 pid: 5837 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802274.406140:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892146560 00000100:00100000:1.0:1788802274.406143:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892146560 00010000:00010000:1.0:1788802274.406157:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d01681600/0x6ecba1490fc9be6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9be64 expref: 20 pid: 5837 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802274.406166:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892146688 00000100:00100000:1.0:1788802274.406168:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892146688 00010000:00010000:1.0:1788802274.406176:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3f95ec00/0x6ecba1490fc9be5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9be56 expref: 21 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802274.406186:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788802274.406191:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+21:3312:x1875694892146432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802274.406201:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802274.406206:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9be72 expref: 21 pid: 5837 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.406216:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9be72 expref: 21 pid: 5837 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.406230:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802274.406293:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+21:3312:x1875694892146432:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802274.406299:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788802274.406312:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788802274.406318:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+20:3313:x1875694892146560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802274.406326:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802274.406330:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d01681600/0x6ecba1490fc9be6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9be64 expref: 20 pid: 5837 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.406348:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d01681600/0x6ecba1490fc9be6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9be64 expref: 20 pid: 5837 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.406358:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802274.406383:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+20:3313:x1875694892146560:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802274.406390:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788802274.406402:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788802274.406408:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892146688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802274.406414:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802274.406418:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3f95ec00/0x6ecba1490fc9be5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9be56 expref: 19 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.406428:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3f95ec00/0x6ecba1490fc9be5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9be56 expref: 19 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.406437:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802274.406456:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892146688:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802274.406462:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788802274.406526:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892146432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802274.406548:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892146688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802274.406555:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892146560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788802274.408172:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3f95fc00/0x6ecba1490fc9be79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9be72 expref: 18 pid: 5837 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802274.408189:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875694892145792:0@lo:104: 00010000:00010000:3.0:1788802274.408202:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01681600/0x6ecba1490fc9be6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9be64 expref: 17 pid: 5837 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802274.408209:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875694892145920:0@lo:104: 00010000:00010000:3.0:1788802274.408218:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3f95ec00/0x6ecba1490fc9be5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9be56 expref: 16 pid: 5836 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802274.408226:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875694892146048:0@lo:104: 00000100:00100000:3.0:1788802274.410597:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875694892146176:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802274.410970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802274.411081:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802274.411909:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875694892146304:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802274.411954:0:11658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802274.412072:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872188288 00000100:00100000:1.0:1788802274.412081:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872188288 00010000:00010000:1.0:1788802274.412121:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3eee8a00/0x6ecba1490fc9be4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec1d expref: 13 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802274.412157:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872188416 00000100:00100000:1.0:1788802274.412161:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872188416 00010000:00010000:1.0:1788802274.412175:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d01681000/0x6ecba1490fc9be48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec16 expref: 14 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802274.412210:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:1.0:1788802274.412221:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+14:2360:x1875694872188288:12345-192.168.201.57@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788802274.412356:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:2.0:1788802274.412367:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f34e9515-dc55-4812-97ce-617e4dd802db+14:2359:x1875694872188416:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802274.412376:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802274.412382:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d01681000/0x6ecba1490fc9be48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec16 expref: 14 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802274.412392:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d01681000/0x6ecba1490fc9be48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec16 expref: 14 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802274.412411:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01681000/0x6ecba1490fc9be48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec16 expref: 14 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802274.412426:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802274.412563:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872188416:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 196us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802274.412571:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00010000:00010000:1.0:1788802274.412722:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802274.412730:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3eee8a00/0x6ecba1490fc9be4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec1d expref: 12 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412739:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3eee8a00/0x6ecba1490fc9be4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec1d expref: 12 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412750:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3eee8a00/0x6ecba1490fc9be4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edec1d expref: 12 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412762:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412771:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412787:0:7624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412795:0:7624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412812:0:7624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412818:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412823:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9e00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802274.412826:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412834:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412846:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802274.412854:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802274.412885:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+11:2360:x1875694872188288:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 666us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802274.412891:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00010000:00010000:2.0:1788802274.413567:0:11658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802274.413579:0:11658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802274.413584:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9bfad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802274.700660:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788802274.707830:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892146816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802274.707929:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802274.708049:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892146816 00000100:00100000:3.0:1788802274.708059:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892146816 00000100:00100000:3.0:1788802274.708137:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788802274.708148:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892146816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788802274.708201:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802274.708292:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892146816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802274.708299:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788802274.708566:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802274.708892:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d33d9dc00 x1875694892146816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802274.708929:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892146816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802274.807996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802274.808107:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802274.808142:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802274.808270:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872188672 00000100:00100000:1.0:1788802274.808280:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872188672 00000100:00100000:3.0:1788802274.808312:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872188544 00000100:00100000:3.0:1788802274.808319:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872188544 00000100:00100000:1.0:1788802274.808346:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872188928 00000100:00100000:1.0:1788802274.808351:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872188928 00000100:00100000:3.0:1788802274.808368:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 253 00000100:00100000:3.0:1788802274.808383:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+11:2357:x1875694872188544:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802274.808386:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 109 00000100:00100000:1.0:1788802274.808400:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2358:x1875694872188672:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:2.0:1788802274.808485:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802274.808503:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 110 00000100:00100000:2.0:1788802274.808513:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2358:x1875694872188928:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802274.808580:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+11:2357:x1875694872188544:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 201us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802274.808589:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 253 00000100:00100000:1.0:1788802274.812972:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2358:x1875694872188672:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 4555us (4845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802274.813010:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 109 00000100:00100000:1.0:1788802274.824527:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2358:x1875694872188928:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 16002us (16370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802274.824543:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 110 00000100:00100000:0.0:1788802274.829876:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802274.829917:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872188800 00000100:00100000:0.0:1788802274.829929:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872188800 00000100:00100000:0.0:1788802274.829997:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:0.0:1788802274.830009:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872188800:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802274.830101:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872188800:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802274.830109:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00080000:2.0:1788802274.830627:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788802275.404622:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788802276.108705:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788802276.108713:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d0450e000 from 7 10000000:01000000:1.0:1788802276.108718:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788802276.108770:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.108782:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.108793:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802276.108817:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892146944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788802276.108886:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802276.108962:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788802276.109011:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892146944 00000100:00100000:0.0:1788802276.109019:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892146944 00000100:00100000:0.0:1788802276.109068:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788802276.109078:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:5840:x1875694892146944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788802276.109091:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802276.109104:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bfbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bfb4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802276.109184:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bfbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bfb4 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802276.109195:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bfbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bfb4 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802276.109205:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0000, rc 0) 00000100:00100000:0.0:1788802276.109287:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892146944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802276.109293:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788802276.109453:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892146944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802276.109585:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.109597:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802276.109649:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892147072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802276.109701:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802276.109771:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788802276.114148:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892147072 00000100:00100000:3.0:1788802276.114586:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892147072 00000100:00100000:3.0:1788802276.114748:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788802276.114759:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892147072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802276.116795:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892147072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2030us (7086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802276.116809:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788802276.125311:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892147072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802276.125412:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892147200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788802276.126039:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802276.126088:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788802276.126177:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892147200 00000100:00100000:0.0:1788802276.126185:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892147200 00000100:00100000:0.0:1788802276.126268:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788802276.126278:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892147200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802276.126507:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892147200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802276.126524:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788802276.127380:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892147200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802276.129418:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11672:1875694892147328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802276.129648:0:11672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802276.129817:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788802276.135927:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892147328 00000100:00100000:0.0:1788802276.135947:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892147328 00000100:00100000:0.0:1788802276.136027:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788802276.136039:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:11672:x1875694892147328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802276.136399:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:11672:x1875694892147328:12345-0@lo:502:llog_process_th.0 Request processed in 359us (6748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802276.136407:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788802276.136664:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11672:1875694892147328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788802276.136701:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788802276.136711:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802276.136715:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788802276.136722:0:11672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910d0450e000 00000020:00000080:1.0:1788802276.136725:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788802276.136822:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11672:1875694892147456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788802276.136866:0:11672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802276.136916:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802276.137033:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892147456 00000100:00100000:2.0:1788802276.137038:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892147456 00000100:00100000:2.0:1788802276.137076:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788802276.137085:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:11672:x1875694892147456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802276.137224:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:11672:x1875694892147456:12345-0@lo:502:llog_process_th.0 Request processed in 140us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802276.137264:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788802276.138618:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c96d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11672:1875694892147456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788802276.138657:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788802276.138665:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802276.138667:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788802276.138671:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788802276.138861:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788802276.138892:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788802276.138904:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802276.138915:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802276.138926:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788802276.138929:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d1d17c800 from 7 10000000:01000000:3.0:1788802276.138932:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788802276.138966:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802276.138973:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802276.138982:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802276.139004:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892147584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788802276.139057:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802276.139095:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788802276.139382:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892147584 00000100:00100000:1.0:1788802276.139388:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892147584 00000100:00100000:1.0:1788802276.139432:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788802276.139441:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:5840:x1875694892147584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802276.139455:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802276.139477:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3a0f2a00/0x6ecba1490fc9bfc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bfc2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.139511:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f2a00/0x6ecba1490fc9bfc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bfc2 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.139522:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3a0f2a00/0x6ecba1490fc9bfc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bfc2 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.139532:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2a00, rc 0) 00000100:00100000:1.0:1788802276.139571:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892147584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802276.139578:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788802276.140017:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892147584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802276.140032:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802276.140041:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802276.140113:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892147712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802276.140145:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802276.140187:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788802276.140581:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892147712 00000100:00100000:1.0:1788802276.140588:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892147712 00000100:00100000:1.0:1788802276.140627:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788802276.140635:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892147712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802276.141322:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892147712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 685us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802276.141330:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788802276.141431:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892147712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802276.141587:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892147840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802276.141628:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802276.141662:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788802276.141993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892147840 00000100:00100000:1.0:1788802276.141999:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892147840 00000100:00100000:1.0:1788802276.142697:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788802276.142713:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892147840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788802276.142953:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892147840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802276.142960:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788802276.144338:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892147840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802276.144596:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11674:1875694892147968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802276.144659:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802276.147283:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802276.160683:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892147968 00000100:00100000:2.0:1788802276.160702:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892147968 00000100:00100000:2.0:1788802276.160769:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788802276.160780:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:11674:x1875694892147968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802276.161083:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:11674:x1875694892147968:12345-0@lo:502:llog_process_th.0 Request processed in 304us (16423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802276.161091:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788802276.161182:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11674:1875694892147968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788802276.161218:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802276.161264:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802276.161267:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788802276.161274:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910d1d17c800 00000020:00000080:2.0:1788802276.161282:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788802276.168817:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11674:1875694892148096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802276.168913:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802276.168966:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d126a8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802276.168994:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892148096 00000100:00100000:2.0:1788802276.169002:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892148096 00000100:00100000:2.0:1788802276.169046:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788802276.169055:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:11674:x1875694892148096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802276.173186:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:11674:x1875694892148096:12345-0@lo:502:llog_process_th.0 Request processed in 4119us (4262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802276.173202:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788802276.190350:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11674:1875694892148096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788802276.190406:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802276.190416:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802276.190431:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788802276.190437:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788802276.190922:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788802276.190941:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788802276.190953:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802276.190965:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802276.190976:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788802276.190980:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d054ea800 from 7 10000000:01000000:2.0:1788802276.190982:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788802276.191022:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802276.191030:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802276.191042:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802276.191079:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08dbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892148224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788802276.191143:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802276.191198:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d126a8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788802276.191370:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892148224 00000100:00100000:1.0:1788802276.191379:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892148224 00000100:00100000:1.0:1788802276.191444:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788802276.191454:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:5840:x1875694892148224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802276.191477:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802276.191489:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3a0f2c00/0x6ecba1490fc9bfd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9bfd0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.191513:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f2c00/0x6ecba1490fc9bfd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9bfd0 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.191525:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3a0f2c00/0x6ecba1490fc9bfd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9bfd0 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.191532:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2c00, rc 0) 00000100:00100000:1.0:1788802276.191580:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892148224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802276.191586:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788802276.191791:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08dbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892148224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802276.191806:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802276.191816:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802276.191865:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08dbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892148352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788802276.191890:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802276.191923:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d126a8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802276.192013:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892148352 00000100:00100000:3.0:1788802276.192018:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892148352 00000100:00100000:3.0:1788802276.192043:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788802276.192051:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892148352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802276.194328:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892148352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2268us (2427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802276.194341:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788802276.194707:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08dbbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892148352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802276.194775:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892148480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788802276.194841:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802276.194870:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802276.195278:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892148480 00000100:00100000:2.0:1788802276.195287:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892148480 00000100:00100000:2.0:1788802276.195335:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788802276.195345:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892148480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802276.195711:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:5840:x1875694892148480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 366us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802276.195719:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788802276.196385:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c96d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dcb700dc-e7bb-457d-b553-2dc4634087c8:5840:1875694892148480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788802276.208374:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788802276.216977:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11676:1875694892148608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788802276.217070:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802276.217114:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802276.219929:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892148608 00000100:00100000:3.0:1788802276.219949:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892148608 00000100:00100000:3.0:1788802276.220008:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788802276.220017:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:11676:x1875694892148608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802276.220335:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:11676:x1875694892148608:12345-0@lo:502:llog_process_th.0 Request processed in 318us (3264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802276.220343:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788802276.220588:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11676:1875694892148608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788802276.220625:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788802276.220636:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802276.220644:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788802276.220653:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910d054ea800 00000020:00000080:1.0:1788802276.220655:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788802276.220784:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11676:1875694892148736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788802276.220827:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802276.220854:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892148736 00000100:00100000:1.0:1788802276.220859:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892148736 00000100:00100000:1.0:1788802276.220882:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788802276.220889:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:11676:x1875694892148736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788802276.221021:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:11676:x1875694892148736:12345-0@lo:502:llog_process_th.0 Request processed in 132us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802276.221029:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788802276.221070:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3f23bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788802276.221082:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dcb700dc-e7bb-457d-b553-2dc4634087c8:11676:1875694892148736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788802276.221099:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788802276.221103:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802276.221105:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788802276.221108:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788802276.221632:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788802276.221655:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788802276.221667:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802276.221681:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802276.403998:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802276.404097:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872189056 00000100:00100000:3.0:1788802276.404109:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872189056 00000100:00100000:3.0:1788802276.404178:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 269 00000100:00100000:3.0:1788802276.404190:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+11:5601:x1875694872189056:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802276.404208:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802276.404302:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee8200/0x6ecba1490fc9bfde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edec6a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802276.404335:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee8200/0x6ecba1490fc9bfde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec6a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802276.404366:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee8200/0x6ecba1490fc9bfde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec6a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802276.404375:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8200, rc 0) 00000100:00100000:3.0:1788802276.404426:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872189056:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 239us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802276.404432:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 269 00000100:00100000:3.0:1788802276.407391:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802276.407527:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872189184 00000100:00100000:1.0:1788802276.407543:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872189184 00000100:00100000:1.0:1788802276.407628:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 270 00000100:00100000:1.0:1788802276.407641:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872189184:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802276.408078:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872189184:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 438us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802276.408087:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 270 00000100:00100000:0.0:1788802276.415118:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802276.415348:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872189312 00000100:00100000:1.0:1788802276.415364:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872189312 00000100:00100000:1.0:1788802276.415478:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 271 00000100:00100000:1.0:1788802276.415491:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872189312:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788802276.416101:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872189312:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 611us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802276.416113:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 271 00000100:00100000:3.0:1788802276.419598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802276.420845:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872189440 00000100:00100000:1.0:1788802276.420864:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872189440 00000100:00100000:1.0:1788802276.420997:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 272 00000100:00100000:1.0:1788802276.421009:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+12:9981:x1875694872189440:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788802276.421542:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+12:9981:x1875694872189440:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 532us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802276.421552:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 272 00000100:00100000:2.0:1788802276.426954:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802276.427900:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872189568 00000100:00100000:1.0:1788802276.427917:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872189568 00000100:00100000:1.0:1788802276.428045:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 273 00000100:00100000:1.0:1788802276.428058:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+12:9981:x1875694872189568:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788802276.428655:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+12:9981:x1875694872189568:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 597us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802276.428665:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 273 00010000:00010000:0.0:1788802276.430595:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802276.438036:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802276.438631:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872189696 00000100:00100000:1.0:1788802276.438645:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872189696 00000100:00100000:1.0:1788802276.438728:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 274 00000100:00100000:1.0:1788802276.438739:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+12:5601:x1875694872189696:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802276.438891:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802276.438918:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3a0f3800/0x6ecba1490fc9bfe5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edec71 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.438976:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f3800/0x6ecba1490fc9bfe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec71 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.438989:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3a0f3800/0x6ecba1490fc9bfe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec71 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802276.439001:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3800, rc 0) 00000100:00100000:1.0:1788802276.439079:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:5601:x1875694872189696:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 342us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802276.439087:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 274 00000100:00100000:3.0:1788802276.446978:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802276.447501:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872189824 00000100:00100000:1.0:1788802276.447517:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872189824 00000100:00100000:0.0:1788802276.451729:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 275 00000100:00100000:0.0:1788802276.451955:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:5601:x1875694872189824:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802276.452665:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:5601:x1875694872189824:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 917us (5700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802276.452675:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 275 00000100:00100000:3.0:1788802276.459068:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802276.459586:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872189952 00000100:00100000:2.0:1788802276.459600:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872189952 00000100:00100000:2.0:1788802276.459744:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 276 00000100:00100000:2.0:1788802276.459758:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:5601:x1875694872189952:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802276.460350:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:5601:x1875694872189952:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 593us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802276.460359:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 276 00000100:00100000:0.0:1788802276.464543:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802276.464974:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872190080 00000100:00100000:2.0:1788802276.464990:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872190080 00000100:00100000:2.0:1788802276.465067:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 277 00000100:00100000:2.0:1788802276.465080:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:9984:x1875694872190080:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788802276.465485:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:9984:x1875694872190080:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 407us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802276.465495:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 277 00000100:00100000:3.0:1788802276.484637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802276.485458:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872190208 00000100:00100000:2.0:1788802276.485476:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872190208 00000100:00100000:2.0:1788802276.485560:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 278 00000100:00100000:2.0:1788802276.485574:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:9984:x1875694872190208:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788802276.487142:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:9984:x1875694872190208:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 591us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802276.487169:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 278 00000100:00100000:2.0:1788802277.260596:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3faea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892149248:0@lo:400:kworker.0 00000100:00100000:1.0:1788802277.260680:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892148864:0@lo:400:kworker.0 00000100:00100000:2.0:1788802277.260704:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802277.260719:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802277.260784:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892149248 00000100:00100000:2.0:1788802277.260793:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892149248 00000100:00100000:3.0:1788802277.260815:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892148992:0@lo:400:kworker.0 00000100:00100000:3.0:1788802277.260848:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802277.260861:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788802277.260865:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892149504:0@lo:400:kworker.0 00000100:00100000:2.0:1788802277.260870:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892149248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802277.260895:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802277.260977:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892149504 00000100:00100000:0.0:1788802277.260981:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892149504 00000100:00100000:0.0:1788802277.261015:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788802277.261022:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892149504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802277.261073:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788802277.261080:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892149120:0@lo:400:kworker.0 00000100:00100000:2.0:1788802277.261134:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892149248:12345-0@lo:400:kworker.0 Request processed in 263us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802277.261157:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788802277.261179:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802277.261183:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788802277.261221:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3faea680 x1875694892149248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802277.261272:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3faea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892149248:0@lo:400:kworker.0 00000100:00100000:2.0:1788802277.261299:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892148992 00000100:00100000:2.0:1788802277.261303:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892148992 00000100:00100000:2.0:1788802277.261332:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788802277.261339:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892148992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802277.261374:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892148992:12345-0@lo:400:kworker.0 Request processed in 35us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802277.261381:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000040:00080000:2.0:1788802277.264121:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788802277.271568:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892149504:12345-0@lo:400:kworker.0 Request processed in 10534us (10658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802277.271585:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788802277.271669:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892148864 00000100:00100000:0.0:1788802277.271693:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892148864 00000100:00100000:0.0:1788802277.271748:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788802277.271758:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3312:x1875694892148864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802277.271820:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3312:x1875694892148864:12345-0@lo:400:kworker.0 Request processed in 64us (11100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802277.271826:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788802277.272281:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892148864:0@lo:400:kworker.0 00000100:00100000:1.0:1788802277.272295:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892149376:0@lo:400:kworker.0 00000100:00100000:1.0:1788802277.272335:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802277.275028:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892149376 00000100:00100000:0.0:1788802277.275044:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892149376 00000100:00100000:0.0:1788802277.275124:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788802277.275150:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892149376:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788802277.275228:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802277.275273:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892149376:12345-0@lo:400:kworker.0 Request processed in 140us (2936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802277.275280:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788802277.275561:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802277.275625:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892148992:0@lo:400:kworker.0 00000100:00100000:2.0:1788802277.275629:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892149120 00000100:00100000:2.0:1788802277.275633:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892149120 00000100:00100000:3.0:1788802277.275640:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892149504:0@lo:400:kworker.0 00000100:00100000:2.0:1788802277.275688:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788802277.275730:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802277.275766:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892149120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802277.275823:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892149120:12345-0@lo:400:kworker.0 Request processed in 60us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802277.275875:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892149120:0@lo:400:kworker.0 00000100:00100000:1.0:1788802277.276337:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892149376:0@lo:400:kworker.0 00000100:00100000:2.0:1788802277.279550:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00010000:1.0:1788802277.452482:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802277.774512:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892149632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802277.774606:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802277.776296:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892149632 00000100:00100000:3.0:1788802277.776314:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892149632 00000100:00100000:3.0:1788802277.776396:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788802277.776407:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875694892149632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788802277.776462:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802277.776552:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875694892149632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802277.776560:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788802277.776694:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892149632:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788802278.476597:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788802278.908893:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1788802279.500497:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802279.826455:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892149760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802279.826846:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802279.827761:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892149760 00000100:00100000:1.0:1788802279.827788:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892149760 00000100:00100000:1.0:1788802279.828300:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788802279.828463:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892149760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788802279.828504:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802279.828586:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892149760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 276us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802279.828593:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788802279.828649:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d33d9c380 x1875694892149760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802279.828671:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892149760:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788802279.829050:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802279.924734:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802279.924853:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802279.926042:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802279.926124:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802279.926149:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872190592 00000100:00100000:2.0:1788802279.926182:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872190592 00000100:00100000:0.0:1788802279.926620:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872190464 00000100:00100000:0.0:1788802279.926626:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872190464 00000100:00100000:0.0:1788802279.926650:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872190336 00000100:00100000:0.0:1788802279.926652:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872190336 00000100:00100000:0.0:1788802279.926696:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 280 00000100:00100000:0.0:1788802279.926704:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872190336:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802279.926783:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872190336:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 79us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802279.926790:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 280 00000100:00100000:1.0:1788802279.927511:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872190720 00000100:00100000:1.0:1788802279.927521:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872190720 00000100:00100000:2.0:1788802279.927644:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:2.0:1788802279.927657:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872190592:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802279.927713:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872190592:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 61us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802279.927720:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:0.0:1788802279.928027:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:0.0:1788802279.928035:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872190464:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802279.928723:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872190464:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 682us (3995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802279.928733:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:1.0:1788802279.929462:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:1.0:1788802279.929555:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872190720:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802279.929621:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872190720:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 72us (4782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802279.929627:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00080000:2.0:1788802279.930934:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788802279.930945:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788802280.525383:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802281.548513:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802282.382009:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892150144:0@lo:400:kworker.0 00000100:00100000:0.0:1788802282.382076:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802282.382151:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788802282.382157:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892150016:0@lo:400:kworker.0 00000100:00100000:0.0:1788802282.382179:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802282.382193:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892150528:0@lo:400:kworker.0 00000100:00100000:0.0:1788802282.382212:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802282.382259:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892150144 00000100:00100000:0.0:1788802282.382268:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892150144 00000100:00100000:0.0:1788802282.382319:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892150016 00000100:00100000:0.0:1788802282.382321:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892150016 00000100:00100000:0.0:1788802282.382339:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788802282.382347:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892150144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802282.382394:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892150144:12345-0@lo:400:kworker.0 Request processed in 48us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802282.382401:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788802282.382415:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788802282.382421:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892150016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802282.382441:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892150016:12345-0@lo:400:kworker.0 Request processed in 21us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802282.382446:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788802282.382462:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892150528 00000100:00100000:0.0:1788802282.382478:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892150528 00000100:00100000:0.0:1788802282.382505:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788802282.382511:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892150528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802282.382536:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892150528:12345-0@lo:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802282.382542:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788802282.382554:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788802282.382558:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802282.382590:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892150016:0@lo:400:kworker.0 00000100:00100000:0.0:1788802282.382601:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788802282.382606:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d3fae9880, transno 4294967300 00000100:00100000:0.0:1788802282.382615:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892150528:0@lo:400:kworker.0 00000100:00100000:0.0:1788802282.382623:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892150144:0@lo:400:kworker.0 00000100:00100000:3.0:1788802282.383089:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892149888:0@lo:400:kworker.0 00000100:00100000:3.0:1788802282.383137:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802282.383173:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892150400:0@lo:400:kworker.0 00000100:00100000:3.0:1788802282.383193:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802282.383212:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802282.383217:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892150272:0@lo:400:kworker.0 00000100:00100000:3.0:1788802282.383234:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802282.383276:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892150272 00000100:00100000:3.0:1788802282.383280:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892150272 00000100:00100000:3.0:1788802282.383311:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788802282.383317:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892150272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802282.383348:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892150272:12345-0@lo:400:kworker.0 Request processed in 31us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802282.383353:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1788802282.383380:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3faebb80 x1875694892150272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802282.383391:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892150272:0@lo:400:kworker.0 00000100:00100000:1.0:1788802282.383475:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892150400 00000100:00100000:1.0:1788802282.383481:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892150400 00000100:00100000:1.0:1788802282.383524:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788802282.383533:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892150400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802282.383575:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892150400:12345-0@lo:400:kworker.0 Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802282.383581:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788802282.383620:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892150400:0@lo:400:kworker.0 00000100:00100000:2.0:1788802282.383782:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892149888 00000100:00100000:2.0:1788802282.383787:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892149888 00000100:00100000:2.0:1788802282.383822:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788802282.383829:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3312:x1875694892149888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802282.383862:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3312:x1875694892149888:12345-0@lo:400:kworker.0 Request processed in 34us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802282.383867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788802282.384351:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892149888:0@lo:400:kworker.0 00000100:00080000:0.0:1788802282.385927:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788802282.385940:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788802282.574541:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802282.895581:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892150656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802282.895666:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802282.898321:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892150656 00000100:00100000:2.0:1788802282.898341:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892150656 00000100:00100000:2.0:1788802282.898423:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788802282.898435:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892150656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802282.898481:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802282.898588:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892150656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802282.898596:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788802282.898919:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892150656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788802283.596562:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802284.624438:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802284.943835:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892150784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802284.943907:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802284.943988:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892150784 00000100:00100000:3.0:1788802284.943996:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892150784 00000100:00100000:3.0:1788802284.944048:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788802284.944056:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892150784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788802284.944101:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802284.944143:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892150784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802284.944150:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788802284.944185:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d33d9c380 x1875694892150784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802284.944203:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892150784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788802284.945441:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802285.047405:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802285.047445:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802285.047470:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802285.047545:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802285.047583:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872190976 00000100:00100000:3.0:1788802285.047595:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872190976 00000100:00100000:3.0:1788802285.047647:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872191232 00000100:00100000:3.0:1788802285.047650:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872191232 00000100:00100000:3.0:1788802285.047672:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:3.0:1788802285.047684:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872190976:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802285.047759:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872190976:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 78us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802285.047766:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:3.0:1788802285.047794:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:3.0:1788802285.047800:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872191232:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802285.047827:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872191232:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802285.047832:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:3.0:1788802285.049317:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872190848 00000100:00100000:3.0:1788802285.049328:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872190848 00000100:00100000:3.0:1788802285.049376:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 282 00000100:00100000:3.0:1788802285.049384:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872190848:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802285.049435:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08defc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872190848:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 52us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802285.049442:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 282 00000100:00100000:0.0:1788802285.051297:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872191104 00000100:00100000:0.0:1788802285.051311:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872191104 00000100:00100000:0.0:1788802285.051373:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:0.0:1788802285.051383:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2359:x1875694872191104:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802285.051451:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2359:x1875694872191104:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 69us (3979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802285.051474:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00080000:0.0:1788802285.051495:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788802285.051499:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788802285.646366:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802286.673103:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788802287.500948:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788802287.503732:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892151040:0@lo:400:kworker.0 00000100:00100000:1.0:1788802287.503824:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802287.503906:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892151552:0@lo:400:kworker.0 00000100:00100000:1.0:1788802287.503932:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802287.503965:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802287.503971:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08dbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892151168:0@lo:400:kworker.0 00000100:00100000:1.0:1788802287.503993:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802287.504023:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892151552 00000100:00100000:1.0:1788802287.504043:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892151552 00000100:00100000:1.0:1788802287.504102:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788802287.504111:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892151552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802287.504170:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892151552:12345-0@lo:400:kworker.0 Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802287.504177:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788802287.504202:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892151040 00000100:00100000:1.0:1788802287.504205:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892151040 00000100:00100000:1.0:1788802287.504227:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892151168 00000100:00100000:1.0:1788802287.504230:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892151168 00000100:00100000:1.0:1788802287.504281:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788802287.504287:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892151040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802287.504320:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892151040:12345-0@lo:400:kworker.0 Request processed in 33us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802287.504337:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788802287.504350:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788802287.504356:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892151168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802287.504384:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892151168:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802287.504389:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788802287.504427:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08dbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892151168:0@lo:400:kworker.0 00000100:00100000:1.0:1788802287.504437:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892151040:0@lo:400:kworker.0 00000100:00100000:1.0:1788802287.504446:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892151552:0@lo:400:kworker.0 00000100:00100000:0.0:1788802287.504822:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892151296:0@lo:400:kworker.0 00000100:00100000:0.0:1788802287.504858:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802287.504891:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788802287.504897:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892150912:0@lo:400:kworker.0 00000100:00100000:0.0:1788802287.504925:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802287.504957:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892151424:0@lo:400:kworker.0 00000100:00100000:0.0:1788802287.504980:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788802287.505010:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788802287.505015:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788802287.505024:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892151424 00000100:00100000:0.0:1788802287.505039:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892151424 00000100:00100000:0.0:1788802287.505075:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788802287.505082:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892151424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802287.505120:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892151424:12345-0@lo:400:kworker.0 Request processed in 38us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802287.505126:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1788802287.505142:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802287.505157:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892151424:0@lo:400:kworker.0 00000100:00100000:2.0:1788802287.505210:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892150912 00000100:00100000:2.0:1788802287.505214:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892150912 00000100:00100000:2.0:1788802287.505278:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788802287.505287:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892150912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802287.505337:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892150912:12345-0@lo:400:kworker.0 Request processed in 51us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802287.505343:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788802287.505986:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892150912:0@lo:400:kworker.0 00000100:00100000:1.0:1788802287.506074:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892151296 00000100:00100000:1.0:1788802287.506079:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892151296 00000100:00100000:1.0:1788802287.506175:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788802287.506185:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892151296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802287.506265:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892151296:12345-0@lo:400:kworker.0 Request processed in 82us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802287.506272:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788802287.506389:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802287.506412:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d08db9c00 x1875694892151296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802287.506436:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892151296:0@lo:400:kworker.0 00010000:00010000:1.0:1788802287.692481:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802288.012902:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892151680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802288.012988:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802288.013158:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892151680 00000100:00100000:2.0:1788802288.013166:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892151680 00000100:00100000:2.0:1788802288.013215:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788802288.013223:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892151680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802288.013286:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802288.013341:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892151680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802288.013348:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788802288.013492:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892151680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788802288.718465:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802289.747155:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802290.060948:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788802290.060973:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892151808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802290.061055:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802290.061195:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892151808 00000100:00100000:2.0:1788802290.061204:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892151808 00000100:00100000:2.0:1788802290.061295:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788802290.061305:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892151808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788802290.061343:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802290.061393:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892151808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802290.061400:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788802290.061422:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3a621880 x1875694892151808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802290.061441:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892151808:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788802290.061642:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802290.165437:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802290.165499:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802290.165625:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872191488 00000100:00100000:0.0:1788802290.165644:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872191488 00000100:00100000:2.0:1788802290.165777:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872191360 00000100:00100000:2.0:1788802290.165782:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872191360 00000100:00080000:3.0:1788802290.165822:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802290.165828:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 284 00000100:00100000:2.0:1788802290.165838:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872191360:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802290.165895:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:0.0:1788802290.165904:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872191488:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802290.165928:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872191360:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 92us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802290.165935:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 284 00000100:00100000:0.0:1788802290.165937:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872191488:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 36us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802290.165941:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:0.0:1788802290.182599:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802290.182657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802290.182766:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872191616 00000100:00100000:1.0:1788802290.182778:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872191616 00000100:00100000:1.0:1788802290.182858:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:1.0:1788802290.182871:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2356:x1875694872191616:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:1.0:1788802290.182920:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bf21 00000100:00080000:1.0:1788802290.182931:0:6687:0:(import.c:65:import_set_state_nolock()) ffff910d3efbf000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788802290.182976:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788802290.183361:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+2:2356:x1875694872191616:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 492us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802290.183370:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00010000:00010000:1.0:1788802290.183394:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788802290.184847:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788802290.185193:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872191744 00000100:00100000:2.0:1788802290.185205:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872191744 00000100:00100000:2.0:1788802290.185315:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00100000:2.0:1788802290.185335:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2358:x1875694872191744:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802290.185417:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2358:x1875694872191744:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 85us (2759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802290.185426:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00080000:3.0:1788802290.185686:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788802290.765908:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802291.788488:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802292.620958:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892152320:0@lo:400:kworker.0 00000100:00100000:2.0:1788802292.621068:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802292.621165:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788802292.621172:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892151936:0@lo:400:kworker.0 00000100:00100000:2.0:1788802292.621208:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802292.621259:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892152448:0@lo:400:kworker.0 00000100:00100000:2.0:1788802292.621289:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802292.621329:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892152320 00000100:00100000:2.0:1788802292.621340:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892152320 00000100:00100000:2.0:1788802292.621423:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788802292.621434:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892152320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802292.621500:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892152320:12345-0@lo:400:kworker.0 Request processed in 68us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802292.621517:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788802292.621551:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892151936 00000100:00100000:2.0:1788802292.621555:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892151936 00000100:00100000:2.0:1788802292.621838:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788802292.621846:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892151936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802292.621881:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892151936:12345-0@lo:400:kworker.0 Request processed in 37us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802292.621904:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788802292.621948:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892152448 00000100:00100000:2.0:1788802292.621952:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892152448 00000100:00100000:2.0:1788802292.621984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788802292.621990:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892152448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802292.622020:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892152448:12345-0@lo:400:kworker.0 Request processed in 30us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802292.622026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1788802292.622046:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788802292.622051:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802292.622084:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892151936:0@lo:400:kworker.0 00000100:00100000:2.0:1788802292.622100:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892152448:0@lo:400:kworker.0 00010000:00080000:2.0:1788802292.622114:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3c700 x1875694892152320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802292.622126:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892152320:0@lo:400:kworker.0 00000100:00100000:0.0:1788802292.622392:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892152192:0@lo:400:kworker.0 00000100:00100000:0.0:1788802292.622434:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802292.622473:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788802292.622480:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892152064:0@lo:400:kworker.0 00000100:00100000:0.0:1788802292.622503:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802292.622791:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892152576:0@lo:400:kworker.0 00000100:00100000:0.0:1788802292.622838:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802292.622876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892152192 00000100:00100000:0.0:1788802292.622881:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892152192 00000100:00100000:0.0:1788802292.622921:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892152064 00000100:00100000:0.0:1788802292.622925:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892152064 00000100:00100000:0.0:1788802292.622958:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788802292.622967:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892152192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802292.623013:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892152192:12345-0@lo:400:kworker.0 Request processed in 48us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802292.623020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788802292.623038:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788802292.623044:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892152064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802292.623073:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892152064:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802292.623079:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788802292.623116:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892152064:0@lo:400:kworker.0 00000100:00100000:0.0:1788802292.623127:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3faebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892152192:0@lo:400:kworker.0 00000100:00080000:2.0:1788802292.623282:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802292.623488:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892152576 00000100:00100000:1.0:1788802292.623493:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892152576 00000100:00100000:1.0:1788802292.623550:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788802292.623558:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892152576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802292.623920:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892152576:12345-0@lo:400:kworker.0 Request processed in 361us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802292.623929:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788802292.624034:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788802292.624923:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892152576:0@lo:400:kworker.0 00010000:00010000:1.0:1788802292.814482:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802293.139952:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788802293.139988:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892152704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802293.140074:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802293.140328:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892152704 00000100:00100000:2.0:1788802293.140339:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892152704 00000100:00100000:2.0:1788802293.140411:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788802293.140423:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892152704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802293.140470:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802293.140721:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892152704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 299us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802293.140730:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788802293.141457:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892152704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788802293.840080:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788802294.235527:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000020:00000080:2.0:1788802294.235539:0:7635:0:(genops.c:885:class_export_put()) final put ffff910d1d17a800/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000020:00000080:2.0:1788802294.235571:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d1d17a800/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 for lustre-OST0001 00000020:00000080:2.0:1788802294.235618:0:1386:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d3efbf000 for lustre-OST0001 00010000:00010000:1.0:1788802294.861089:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802295.183290:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892152832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802295.183403:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802295.183757:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892152832 00000100:00100000:0.0:1788802295.183770:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892152832 00000100:00100000:0.0:1788802295.183859:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788802295.183872:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892152832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802295.183928:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802295.183995:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892152832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802295.184020:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788802295.185983:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788802295.186077:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d0121b800 x1875694892152832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802295.186111:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892152832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802295.282935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802295.282998:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802295.283069:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872191872 00000100:00100000:3.0:1788802295.283083:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872191872 00000100:00100000:3.0:1788802295.283146:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 286 00000100:00100000:3.0:1788802295.283177:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2358:x1875694872191872:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802295.283306:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2358:x1875694872191872:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 133us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802295.283315:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 286 00000100:00100000:3.0:1788802295.284505:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872192128 00000100:00100000:3.0:1788802295.284521:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872192128 00000100:00100000:3.0:1788802295.284727:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 129 00000100:00100000:3.0:1788802295.284740:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2358:x1875694872192128:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802295.284826:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2358:x1875694872192128:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 89us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802295.284834:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 129 00000100:00080000:3.0:1788802295.288375:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802295.288500:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802295.288811:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872192000 00000100:00100000:2.0:1788802295.288825:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872192000 00000100:00100000:2.0:1788802295.288928:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 130 00000100:00100000:2.0:1788802295.288942:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872192000:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802295.289064:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872192000:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 125us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802295.289074:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 130 00000100:00080000:1.0:1788802295.289299:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788802295.890385:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802296.920841:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802297.740543:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0121a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892152960:0@lo:400:kworker.0 00000100:00100000:2.0:1788802297.741066:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802297.741170:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d01219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892153344:0@lo:400:kworker.0 00000100:00100000:2.0:1788802297.741210:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d01219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892153472:0@lo:400:kworker.0 00000100:00100000:0.0:1788802297.741212:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802297.741281:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802297.741289:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d01219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892153088:0@lo:400:kworker.0 00000100:00100000:0.0:1788802297.742151:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802297.742200:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d01218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892153600:0@lo:400:kworker.0 00000100:00100000:0.0:1788802297.742268:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802297.742297:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788802297.742306:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892153216:0@lo:400:kworker.0 00000040:00080000:3.0:1788802297.742619:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788802297.743231:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802297.743641:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892153344 00000100:00100000:0.0:1788802297.743653:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892153344 00000100:00100000:0.0:1788802297.743748:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892153600 00000100:00100000:0.0:1788802297.743752:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892153600 00000100:00100000:0.0:1788802297.743794:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788802297.743806:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892153344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802297.743906:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892153344:12345-0@lo:400:kworker.0 Request processed in 103us (2694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802297.743914:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788802297.744390:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892152960 00000100:00100000:3.0:1788802297.744397:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892152960 00000100:00100000:3.0:1788802297.744443:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788802297.744452:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3312:x1875694892152960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802297.744530:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08ded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3312:x1875694892152960:12345-0@lo:400:kworker.0 Request processed in 80us (3465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802297.744537:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788802297.744575:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892153472 00000100:00100000:3.0:1788802297.744579:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892153472 00000100:00100000:3.0:1788802297.744607:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892153088 00000100:00100000:3.0:1788802297.744611:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892153088 00000100:00100000:3.0:1788802297.744622:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892153216 00000100:00100000:3.0:1788802297.744625:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892153216 00000100:00100000:3.0:1788802297.744653:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788802297.744658:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892153472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802297.744694:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892153472:12345-0@lo:400:kworker.0 Request processed in 35us (3414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802297.744700:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788802297.744712:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788802297.744718:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892153088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802297.744756:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892153088:12345-0@lo:400:kworker.0 Request processed in 38us (3434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802297.744762:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788802297.744774:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788802297.744782:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892153216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802297.744815:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892153216:12345-0@lo:400:kworker.0 Request processed in 33us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802297.744822:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788802297.744840:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788802297.744861:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892153600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802297.744927:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d01219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892153472:0@lo:400:kworker.0 00000100:00100000:3.0:1788802297.744942:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0121a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892152960:0@lo:400:kworker.0 00000100:00100000:0.0:1788802297.745458:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892153600:12345-0@lo:400:kworker.0 Request processed in 606us (3186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802297.745468:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788802297.745519:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788802297.745527:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788802297.745530:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802297.746190:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d01219c00 x1875694892153344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802297.746211:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d01219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892153344:0@lo:400:kworker.0 00000100:00100000:0.0:1788802297.746306:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892153216:0@lo:400:kworker.0 00000100:00100000:0.0:1788802297.746655:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d01219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892153088:0@lo:400:kworker.0 00000100:00100000:0.0:1788802297.746675:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d01218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892153600:0@lo:400:kworker.0 00010000:00010000:1.0:1788802297.933431:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802298.252548:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892153728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802298.252621:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802298.252799:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892153728 00000100:00100000:2.0:1788802298.252808:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892153728 00000100:00100000:2.0:1788802298.252871:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788802298.252881:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892153728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802298.252915:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802298.252969:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892153728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802298.252976:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788802298.253123:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892153728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788802298.956603:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788802299.499068:0:11845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 13:31:37 (1788802297) 00010000:00010000:0.0:1788802299.980694:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802300.300865:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802300.300898:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d01219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892153856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802300.300984:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802300.301136:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892153856 00000100:00100000:0.0:1788802300.301146:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892153856 00000100:00100000:0.0:1788802300.301215:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788802300.301225:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892153856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802300.301283:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802300.301352:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892153856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802300.301359:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788802300.301397:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d01219880 x1875694892153856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802300.301416:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d01219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892153856:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788802300.301776:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802300.406490:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802300.406569:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802300.406694:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872192256 00000100:00100000:2.0:1788802300.406705:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872192256 00000100:00100000:2.0:1788802300.406768:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 288 00000100:00100000:2.0:1788802300.406784:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872192256:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802300.406871:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08decc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872192256:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 87us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802300.406878:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 288 00000100:00100000:3.0:1788802300.407288:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802300.420911:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872192512 00000100:00100000:0.0:1788802300.420949:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872192512 00000100:00100000:2.0:1788802300.421823:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872192384 00000100:00100000:2.0:1788802300.421833:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872192384 00000100:00100000:2.0:1788802300.421944:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00100000:2.0:1788802300.421959:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2359:x1875694872192384:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802300.422199:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2359:x1875694872192384:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 244us (14910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802300.422208:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00080000:0.0:1788802300.423220:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802300.424417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 135 00000100:00100000:1.0:1788802300.424431:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872192512:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802300.424519:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872192512:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 90us (17948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802300.424526:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 135 00000100:00080000:0.0:1788802300.424606:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788802301.005202:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802301.171351:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802301.172933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872192640 00000100:00100000:2.0:1788802301.172949:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872192640 00000100:00100000:2.0:1788802301.173025:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:2.0:1788802301.173037:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:10255:x1875694872192640:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802301.173059:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802301.173139:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9bfec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec78 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.173204:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9bff3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.173217:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9bff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.173230:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9bff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802301.173322:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788802301.173326:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802301.173367:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9bff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.173391:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9bfec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec78 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.173410:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9bff3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec78 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.173418:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802301.173420:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802301.173424:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f800, rc 0) 00000100:00100000:2.0:1788802301.173506:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:10255:x1875694872192640:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 470us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802301.173513:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:3.0:1788802301.186199:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802301.186332:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872192768 00000100:00100000:1.0:1788802301.186341:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872192768 00000100:00100000:1.0:1788802301.186400:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:1.0:1788802301.186409:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:10256:x1875694872192768:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788802301.186430:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802301.186454:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9bffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec7f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186516:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c001 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186530:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186542:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186556:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c008 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186563:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186588:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186833:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2200/0x6ecba1490fc9c00f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186843:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2200/0x6ecba1490fc9c00f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186851:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2200/0x6ecba1490fc9c00f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802301.186877:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788802301.186880:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802301.186901:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2200/0x6ecba1490fc9c00f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186911:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186917:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c001 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186923:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c001 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186928:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802301.186932:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c001 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186939:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c001 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186957:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:1.0:1788802301.186959:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802301.186965:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186971:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186989:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186994:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c008 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.186999:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.187004:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802301.187006:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.187011:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c008 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.187017:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff910d05184f00) 00010000:00010000:1.0:1788802301.187020:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802301.187022:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c008 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.187028:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c008 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.187073:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9bffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec7f expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.187087:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2200/0x6ecba1490fc9c00f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec7f expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802301.187095:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910d05184d00) 00010000:00010000:1.0:1788802301.187097:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788802301.187099:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2200, rc 0) 00000100:00100000:1.0:1788802301.187162:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:10256:x1875694872192768:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 753us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802301.187169:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:0.0:1788802301.195570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802301.195671:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872193024 00000100:00100000:2.0:1788802301.195682:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872193024 00000100:00100000:2.0:1788802301.195754:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:2.0:1788802301.195764:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:10256:x1875694872193024:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802301.195784:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802301.195814:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c016 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec86 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.195889:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c01d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.195915:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c01d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.195925:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c01d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.199376:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c024 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.199402:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c024 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.199416:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c024 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200293:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9c02b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200305:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9c02b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200314:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9c02b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802301.200324:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788802301.200487:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c01d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200496:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c01d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200503:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c01d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200518:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95fc00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802301.200523:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c01d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200531:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c01d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200544:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910d05184d00) 00010000:00010000:2.0:1788802301.200547:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802301.200552:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c01d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200558:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c01d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200570:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c024 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200576:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c024 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200582:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c024 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200586:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ec00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802301.200589:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c024 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200595:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c024 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200612:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff910d2166a400) 00010000:00010000:2.0:1788802301.200615:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802301.200618:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c024 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.200624:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c024 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.201500:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c016 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec86 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.201519:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9c02b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec86 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802301.201528:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:2.0:1788802301.201531:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802301.201533:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95e000, rc 0) 00000100:00100000:2.0:1788802301.201606:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:10256:x1875694872193024:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 5843us (6045us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788802301.201615:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:3.0:1788802301.209793:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802301.209882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872193152 00000100:00100000:1.0:1788802301.209892:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872193152 00000100:00100000:1.0:1788802301.209960:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:1.0:1788802301.209971:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:10256:x1875694872193152:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788802301.210094:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:10256:x1875694872193152:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 Request processed in 125us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802301.210100:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000040:00080000:0.0:1788802301.836902:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788802302.030903:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802302.862115:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892153984:0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.862263:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802302.862336:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892154496:0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.862370:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802302.862405:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788802302.862411:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892154368:0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.862464:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802302.862506:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892154112:0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.862536:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802302.862861:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892154496 00000100:00100000:2.0:1788802302.862873:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892154496 00000100:00100000:2.0:1788802302.862957:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892154112 00000100:00100000:2.0:1788802302.862961:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892154112 00000100:00100000:2.0:1788802302.862988:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788802302.863001:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892154496:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788802302.863079:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802302.863422:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892154624:0@lo:400:kworker.0 00000100:00100000:2.0:1788802302.866167:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875694892154496:12345-0@lo:400:kworker.0 Request processed in 3155us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802302.866197:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788802302.866279:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788802302.866294:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892154112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802302.866360:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892154112:12345-0@lo:400:kworker.0 Request processed in 73us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802302.866367:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788802302.866797:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875694892154496:0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.868628:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802302.868744:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892154112:0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.868776:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802302.868792:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08dbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892154240:0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.868835:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802302.868902:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892153984 00000100:00100000:1.0:1788802302.868912:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892153984 00000100:00100000:1.0:1788802302.868976:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788802302.868984:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3312:x1875694892153984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.869038:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3312:x1875694892153984:12345-0@lo:400:kworker.0 Request processed in 55us (6777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802302.869045:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788802302.869084:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892154240 00000100:00100000:1.0:1788802302.869088:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892154240 00000100:00100000:1.0:1788802302.869302:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788802302.869310:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892154240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.869347:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892154240:12345-0@lo:400:kworker.0 Request processed in 39us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802302.869353:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788802302.869376:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892154368 00000100:00100000:1.0:1788802302.869380:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892154368 00000100:00100000:1.0:1788802302.869409:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892154624 00000100:00100000:1.0:1788802302.869431:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892154624 00000100:00100000:1.0:1788802302.869453:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788802302.869459:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892154368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.869489:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892154368:12345-0@lo:400:kworker.0 Request processed in 31us (7025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802302.869494:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788802302.869504:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788802302.869509:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892154624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.869531:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892154624:12345-0@lo:400:kworker.0 Request processed in 24us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802302.869535:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788802302.869567:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788802302.869572:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788802302.869574:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802302.869599:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08dbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892154240:0@lo:400:kworker.0 00000100:00100000:1.0:1788802302.869610:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892154624:0@lo:400:kworker.0 00010000:00080000:2.0:1788802302.872016:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d21a95880 x1875694892154368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788802318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802302.872036:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892154368:0@lo:400:kworker.0 00000100:00100000:2.0:1788802302.872048:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892153984:0@lo:400:kworker.0 00010000:00010000:1.0:1788802303.053315:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802303.373879:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892154752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802303.373991:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802303.374176:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892154752 00000100:00100000:2.0:1788802303.374189:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892154752 00000100:00100000:2.0:1788802303.374282:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788802303.374295:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892154752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802303.374342:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802303.374400:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892154752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802303.374408:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788802303.377504:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892154752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802303.418987:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802303.419085:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872193280 00000100:00100000:0.0:1788802303.419099:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872193280 00000100:00100000:0.0:1788802303.419197:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:0.0:1788802303.419211:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:10298:x1875694872193280:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802303.419270:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802303.419301:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419396:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c040 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419417:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419433:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419451:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c047 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419458:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419465:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419769:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419786:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c040 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419793:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c040 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419799:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802303.419805:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c040 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419814:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c040 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419828:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:0.0:1788802303.419832:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802303.419839:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c040 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419845:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c040 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419861:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419867:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c047 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419874:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c047 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419879:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802303.419888:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c047 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419894:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c047 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419902:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff910d02db8300) 00010000:00010000:0.0:1788802303.419904:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802303.419907:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c047 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419912:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c047 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419951:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c039 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec8d expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419961:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:0.0:1788802303.419963:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802303.419967:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec8d expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.419977:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0400, rc 0) 00000100:00100000:0.0:1788802303.420059:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:10298:x1875694872193280:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 851us (1089us total) trans 0 rc 301/301 00000100:00100000:0.0:1788802303.420066:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00080000:1.0:1788802303.420229:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802303.428054:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802303.428159:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872193536 00000100:00100000:1.0:1788802303.428173:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872193536 00000100:00100000:1.0:1788802303.428276:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:1.0:1788802303.428289:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:10298:x1875694872193536:12345-192.168.201.57@tcp:36:lfs.0 00010000:00010000:1.0:1788802303.428368:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802303.428414:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9bff3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec78 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.428437:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:1.0:1788802303.428452:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802303.428849:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c04e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.428868:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c04e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.428882:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c04e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.428897:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.428905:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.428912:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802303.433167:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788802303.433194:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c04e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.433207:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c04e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.433216:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c04e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.433275:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802303.433282:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c04e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.433291:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c04e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.433315:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d05184c00) 00010000:00010000:1.0:1788802303.433319:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802303.433326:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c04e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.433333:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c04e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788802303.433366:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002aba5bca reply state 00000000e1aed524 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802303.433380:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788802303.433574:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:10298:x1875694872193536:12345-192.168.201.57@tcp:36:lfs.0 Request processed in 5281us (5531us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788802303.433586:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00010000:00010000:2.0:1788802303.441499:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.441526:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.441559:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.441567:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802303.441572:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.441582:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.441602:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff910d05184100) 00010000:00010000:2.0:1788802303.441606:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802303.441613:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.441620:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c055 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802303.579129:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802303.579295:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872193664 00000100:00100000:0.0:1788802303.579311:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872193664 00000100:00100000:0.0:1788802303.579387:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:0.0:1788802303.579400:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:10306:x1875694872193664:12345-192.168.201.57@tcp:101:lctl.0 00010000:00010000:0.0:1788802303.579454:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802303.579490:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c05c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec94 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.579583:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c063 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.579599:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.579609:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802303.579648:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788802303.579651:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802303.579690:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.579717:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c05c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec94 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.579738:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec94 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.579759:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8300) 00010000:00010000:0.0:1788802303.579762:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788802303.579767:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1a00, rc 0) 00000100:00100000:0.0:1788802303.579836:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:10306:x1875694872193664:12345-192.168.201.57@tcp:101:lctl.0 Request processed in 438us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802303.579845:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:0.0:1788802303.673295:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802303.673416:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872193792 00000100:00100000:2.0:1788802303.673431:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872193792 00000100:00100000:2.0:1788802303.673513:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:2.0:1788802303.673526:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:10312:x1875694872193792:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788802303.673563:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802303.673592:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c06a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edec9b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.673674:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c071 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.673717:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.673732:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.673760:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.673768:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.673775:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.673903:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9c07f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.673912:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9c07f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.673920:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9c07f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802303.673956:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788802303.673960:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802303.674004:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9c07f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674018:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674035:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c071 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674042:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674049:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802303.674054:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674063:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c071 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674078:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8300) 00010000:00010000:2.0:1788802303.674081:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802303.674087:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674092:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674109:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674114:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c078 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674120:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674125:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802303.674133:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674139:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674146:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff910d2166a000) 00010000:00010000:2.0:1788802303.674148:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802303.674151:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c078 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674156:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674193:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c06a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec9b expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674209:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9c07f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec9b expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.674217:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:2.0:1788802303.674219:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788802303.674222:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f800, rc 0) 00000100:00100000:2.0:1788802303.674504:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:10312:x1875694872193792:12345-192.168.201.57@tcp:101:bash.0 Request processed in 978us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802303.674515:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:1.0:1788802303.688973:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802303.690904:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872194048 00000100:00100000:0.0:1788802303.690926:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872194048 00000100:00100000:0.0:1788802303.691026:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:0.0:1788802303.691041:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:10312:x1875694872194048:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802303.691075:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802303.691106:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c086 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeca2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.694994:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c08d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.695028:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c08d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.695047:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c08d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.695087:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.695096:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.695103:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788802303.698078:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788802303.698405:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.698429:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.698445:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.698504:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c08d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.698526:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c08d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.698536:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c08d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.698542:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802303.698558:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c08d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.698588:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c08d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.698602:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802303.698606:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802303.698613:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c08d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.698620:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c08d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788802303.698638:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066a53512 reply state 000000006f4d0b48 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802303.698649:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788802303.698696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c086 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca2 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.698715:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca2 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.699695:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184c00) 00010000:00010000:1.0:1788802303.699701:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802303.699706:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2800, rc 0) 00000100:00100000:1.0:1788802303.699974:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10312:x1875694872194048:12345-192.168.201.57@tcp:101:bash.0 Request processed in 8932us (11013us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788802303.699985:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00010000:00010000:2.0:1788802303.703566:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.703589:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.703616:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.703623:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802303.703628:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.703638:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.703661:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d05184f00) 00010000:00010000:2.0:1788802303.703664:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802303.703671:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.703678:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c094 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802303.711984:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802303.712166:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872194176 00000100:00100000:0.0:1788802303.712181:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872194176 00000100:00100000:0.0:1788802303.712288:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788802303.712300:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875694872194176:12345-192.168.201.57@tcp:8:bash.0 00010000:00080000:0.0:1788802303.712344:0:8127:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:0.0:1788802303.712388:0:8127:0:(genops.c:1384:class_connect()) connect: client df790e2a-6b5b-4b00-92e8-29e1cf7bde69, cookie 0x6ecba1490fc9c0a9 00002000:00100000:0.0:1788802303.712406:0:8127:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df790e2a-6b5b-4b00-92e8-29e1cf7bde69/ffff910d1d3ae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788802303.712440:0:8127:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788802303.712783:0:8127:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788802303.712829:0:8127:0:(import.c:65:import_set_state_nolock()) ffff910d1d3ad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788802303.712950:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2356:x1875694872194176:12345-192.168.201.57@tcp:8:bash.0 Request processed in 650us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802303.712959:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788802303.716986:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802303.717103:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872194304 00000100:00100000:1.0:1788802303.717137:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872194304 00000100:00100000:1.0:1788802303.717281:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:1.0:1788802303.717294:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:0:x1875694872194304:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788802303.717321:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802303.717353:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9c0b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeca9 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788802303.717391:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802303.717417:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1788802303.717422:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802303.717434:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9c0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca9 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.717456:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9c0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca9 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.717482:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2e00, rc 0) 00000100:00100000:1.0:1788802303.717559:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:0:x1875694872194304:12345-192.168.201.57@tcp:101:bash.0 Request processed in 268us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802303.717565:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00080000:3.0:1788802303.718064:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802303.720115:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802303.720337:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872194432 00000100:00100000:0.0:1788802303.720350:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872194432 00000100:00100000:0.0:1788802303.720425:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788802303.720438:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:10312:x1875694872194432:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802303.720490:0:8127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802303.720523:0:8127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edecb0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.720573:0:8127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9c0b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca9 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.720584:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802303.720589:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802303.720595:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.720638:0:8127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9c0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca9 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802303.720656:0:8127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9c0b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca9 expref: 8 pid: 6690 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802303.720674:0:8127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d01218000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8127:1875694892154880:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802303.721182:0:8127:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788802303.724098:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802303.729738:0:8127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d01218000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8127:1875694892154880:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802303.729802:0:8127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.729831:0:8127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1600, rc 0) 00000100:00100000:1.0:1788802303.729940:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:10312:x1875694872194432:12345-192.168.201.57@tcp:101:bash.0 Request processed in 9503us (9836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802303.729970:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:2.0:1788802303.733376:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872194560 00000100:00100000:2.0:1788802303.733407:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872194560 00010000:00010000:2.0:1788802303.733655:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9c0b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca9 expref: 8 pid: 6690 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802303.733903:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:2.0:1788802303.733918:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2360:x1875694872194560:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802303.733943:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802303.733977:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9c0b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca9 expref: 8 pid: 6690 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.734429:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9c0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca9 expref: 8 pid: 6690 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.734537:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9c0b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca9 expref: 8 pid: 6690 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.734711:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802303.734717:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802303.734750:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.734764:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802303.734821:0:7624:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802303.734842:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7624:1875694892155008:192.168.201.57@tcp:105: 00000100:00100000:2.0:1788802303.734985:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08a65000 going to sleep for 11 seconds 00000100:00100000:0.0:1788802303.739442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802303.739595:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872194816 00000100:00100000:3.0:1788802303.739609:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872194816 00000100:00100000:3.0:1788802303.739682:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:3.0:1788802303.739695:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:10312:x1875694872194816:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:3.0:1788802303.740259:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10312:x1875694872194816:12345-192.168.201.57@tcp:35:bash.0 Request processed in 542us (808us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788802303.740270:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788802303.740628:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7624:1875694892155008:192.168.201.57@tcp:105: 00010000:00010000:2.0:1788802303.740663:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802303.740696:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872194560:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 6783us (16614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802303.740709:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:0.0:1788802303.836507:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802303.836628:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872195072 00000100:00100000:1.0:1788802303.836644:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872195072 00000100:00100000:1.0:1788802303.836737:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:1.0:1788802303.836760:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10322:x1875694872195072:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802303.836795:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802303.836827:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c0be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edecb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802303.837385:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788802303.837538:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c0be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb7 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.837555:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8300) 00010000:00010000:1.0:1788802303.837559:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788802303.837565:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c0be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb7 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.837581:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2e00, rc 0) 00000100:00100000:1.0:1788802303.837763:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:10322:x1875694872195072:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1006us (1275us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788802303.837772:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:3.0:1788802303.842283:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802303.842434:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872195328 00000100:00100000:2.0:1788802303.842448:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872195328 00000100:00100000:2.0:1788802303.842525:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:2.0:1788802303.842539:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:10322:x1875694872195328:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788802303.842910:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:10322:x1875694872195328:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 373us (688us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788802303.842918:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788802303.921495:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802303.921612:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872195456 00000100:00100000:1.0:1788802303.921626:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872195456 00000100:00100000:1.0:1788802303.921714:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:1.0:1788802303.921727:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:10328:x1875694872195456:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802303.921794:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802303.921826:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c0cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edecbe expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.921924:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c0d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.921956:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.921972:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802303.922015:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788802303.922019:0:9415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802303.922044:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.922078:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c0cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecbe expref: 18 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.922103:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecbe expref: 17 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.922114:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802303.922118:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788802303.922122:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3c00, rc 0) 00000100:00100000:1.0:1788802303.922329:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:10328:x1875694872195456:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 605us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802303.922338:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:2.0:1788802303.929697:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802303.929927:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872195712 00000100:00100000:3.0:1788802303.929950:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872195712 00000100:00100000:3.0:1788802303.930032:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:3.0:1788802303.930045:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:10328:x1875694872195712:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802303.930075:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802303.930104:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c0da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edecc5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802303.930306:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c0e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802303.930345:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802303.930364:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802303.930382:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788802303.930574:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c0da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecc5 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802303.930601:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecc5 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802303.930613:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184c00) 00010000:00010000:3.0:1788802303.930616:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788802303.930621:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8800, rc 0) 00000100:00100000:3.0:1788802303.930716:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10328:x1875694872195712:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 674us (1035us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788802303.930725:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:0.0:1788802303.935196:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802303.935323:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802303.935425:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872195968 00000100:00100000:1.0:1788802303.935448:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872195968 00000100:00100000:1.0:1788802303.935534:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:1.0:1788802303.935548:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10328:x1875694872195968:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802303.935587:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802303.935620:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c0ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeccc expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.935793:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c0f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.935812:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c0f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.935829:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c0f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802303.935846:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788802303.936027:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c0ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeccc expref: 22 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.936051:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c0f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeccc expref: 21 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.936062:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184c00) 00010000:00010000:1.0:1788802303.936066:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788802303.936070:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2000, rc 0) 00000100:00100000:1.0:1788802303.936162:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10328:x1875694872195968:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 617us (982us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788802303.936191:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:3.0:1788802303.936721:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872196096 00000100:00100000:3.0:1788802303.936730:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872196096 00000100:00100000:3.0:1788802303.936846:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:3.0:1788802303.936858:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:2357:x1875694872196096:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802303.936872:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802303.936893:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c0e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecc5 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802303.936924:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184c00) 00010000:00010000:3.0:1788802303.936928:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802303.936978:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:2357:x1875694872196096:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 124us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802303.936985:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:0.0:1788802303.943625:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802303.943823:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872196224 00000100:00100000:1.0:1788802303.943837:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872196224 00000100:00100000:1.0:1788802303.943914:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:1.0:1788802303.943927:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872196224:12345-192.168.201.57@tcp:1:lfs.0 00010000:00010000:1.0:1788802303.944002:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.944030:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.944039:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802303.944045:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802303.944050:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.944096:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802303.944112:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 7 pid: 8127 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802303.944129:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1875694892155136:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802303.944327:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d167b0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788802303.949970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802303.951110:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872196352 00000100:00100000:3.0:1788802303.951134:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872196352 00002000:00100000:3.0:1788802303.951206:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff910d0121a300 x1875694872196352/t0(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:444/0 lens 504/0 e 0 to 0 dl 1788802314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788802303.951221:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d0121a300 with x1875694872196352 ext(0->12) 00010000:00010000:3.0:1788802303.951233:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 8 pid: 8127 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802303.951299:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 8 pid: 8127 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788802303.951310:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910d0121a300 00000100:00100000:3.0:1788802303.951361:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788802303.951379:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872196352:12345-192.168.201.57@tcp:4:lfs.0 00000100:00100000:1.0:1788802303.952296:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1875694892155136:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802303.952343:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788802304.033143:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000100:00100000:0.0:1788802304.034190:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2359:x1875694872196352:12345-192.168.201.57@tcp:4:lfs.0 Request processed in 82806us (84221us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788802304.036097:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00002000:00100000:0.0:1788802304.036123:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff910d0121a300 x1875694872196352/t4294967299(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:444/0 lens 504/448 e 0 to 0 dl 1788802314 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788802304.036136:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d0121a300 with x1875694872196352 ext(0->12) 00010000:00010000:0.0:1788802304.036151:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 9 pid: 8127 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.036177:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 9 pid: 8127 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788802304.036186:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910d0121a300 00000100:00100000:0.0:1788802304.039939:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802304.040437:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872196480 00000100:00100000:1.0:1788802304.040451:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872196480 00010000:00010000:1.0:1788802304.040505:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 9 pid: 8127 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802304.040564:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:1.0:1788802304.040575:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2360:x1875694872196480:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802304.040590:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788802304.040610:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788802304.040614:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788802303 00002000:00010000:1.0:1788802304.040617:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788802303 00002000:00010000:1.0:1788802304.040619:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788802303 00010000:00010000:1.0:1788802304.040627:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 9 pid: 8127 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.040642:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 9 pid: 8127 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.040667:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018f4352d/0x6ecba1490fc9c0b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecb0 expref: 9 pid: 8127 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.040684:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802304.040704:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802304.040711:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.040721:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.040768:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802304.040840:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2360:x1875694872196480:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 266us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802304.040848:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00010000:00010000:0.0:1788802304.040973:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.040994:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.041035:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.041044:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.041070:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.041077:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802304.041082:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.041091:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.041114:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.041122:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9c104 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802304.045834:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872196224:12345-192.168.201.57@tcp:1:lfs.0 Request processed in 101898us (102213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802304.045851:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:0.0:1788802304.048894:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802304.050195:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872196736 00000100:00100000:2.0:1788802304.050343:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872196736 00000100:00100000:2.0:1788802304.050420:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788802304.050433:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:10328:x1875694872196736:12345-192.168.201.57@tcp:35:lfs.0 00000004:00010000:2.0:1788802304.050821:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c0f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeccc expref: 20 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788802304.053093:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788802304.053441:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788802304.058402:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788802304.058552:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.058581:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca2 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.058592:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.058647:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca2 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.058909:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca2 expref: 24 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802304.058931:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875694892155264:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802304.059672:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08a65240 going to sleep for 11 seconds 00000100:00100000:0.0:1788802304.064623:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802304.064812:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872196864 00000100:00100000:1.0:1788802304.064828:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872196864 00010000:00010000:1.0:1788802304.064888:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca2 expref: 25 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802304.064934:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:1.0:1788802304.064956:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:2360:x1875694872196864:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802304.064976:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802304.064985:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca2 expref: 25 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.065000:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca2 expref: 25 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.065056:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184c00) 00010000:00010000:1.0:1788802304.065064:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.065077:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.065087:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.065115:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802304.065209:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:2360:x1875694872196864:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 247us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802304.065217:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00010000:00010000:2.0:1788802304.065856:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c09b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeca2 expref: 24 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802304.065882:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875694892155264:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802304.065915:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.065927:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.065944:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788802304.066162:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788802304.066503:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788802304.066676:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875694892155392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788802304.066919:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802304.067001:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892155392 00000100:00100000:2.0:1788802304.067010:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892155392 00000100:00100000:2.0:1788802304.067070:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788802304.067079:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875694892155392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788802304.068298:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802304.068321:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08a65900 going to sleep for 11 seconds 00000100:00100000:2.0:1788802304.071842:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875694892155392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 4754us (4923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802304.071858:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788802304.072554:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875694892155392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788802304.077154:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:1.0:1788802304.077342:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802304.080048:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875694892155520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788802304.080148:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802304.080263:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788802304.080448:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892155520 00000100:00100000:3.0:1788802304.080722:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892155520 00000100:00100000:3.0:1788802304.080841:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788802304.080852:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875694892155520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788802304.081098:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875694892155520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 247us (949us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788802304.081106:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788802304.081189:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875694892155520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788802304.081287:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788802304.081352:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.081376:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.081384:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.081389:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802304.081394:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.081401:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.081417:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184c00) 00010000:00010000:0.0:1788802304.081420:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788802304.081426:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.081432:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c10b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788802304.081667:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788802304.081916:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788802304.081929:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357028690196ns, next at 358028688178ns, rc = 0 00000001:00080000:0.0:1788802304.081936:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788802304.081977:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184c00) 00010000:00010000:0.0:1788802304.081980:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788802304.081988:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c0f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeccc expref: 28 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802304.082122:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:10328:x1875694872196736:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 31691us (33243us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788802304.082131:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000020:00080000:0.0:1788802304.082135:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788802304.094076:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802304.094565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872196992 00000100:00100000:3.0:1788802304.094584:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872196992 00000100:00100000:3.0:1788802304.094681:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:3.0:1788802304.094693:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:10328:x1875694872196992:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802304.094726:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802304.094764:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c112 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edecd3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.094841:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c112 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecd3 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.094859:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c112 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecd3 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.094881:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802304.094885:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788802304.094889:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8800, rc 0) 00000100:00100000:3.0:1788802304.094991:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:10328:x1875694872196992:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 300us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802304.094998:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:1.0:1788802304.104105:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802304.104202:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872197248 00000100:00100000:0.0:1788802304.104219:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872197248 00000100:00100000:0.0:1788802304.104370:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:0.0:1788802304.104385:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:10328:x1875694872197248:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788802304.104678:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:10328:x1875694872197248:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 296us (592us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788802304.104697:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:0.0:1788802304.208112:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802304.208234:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872197504 00000100:00100000:2.0:1788802304.208327:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872197504 00000100:00100000:2.0:1788802304.208392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:2.0:1788802304.208402:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:10338:x1875694872197504:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802304.208427:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802304.208449:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edecda expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802304.208533:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788802304.208652:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c119 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecda expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.208666:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8300) 00010000:00010000:2.0:1788802304.208670:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788802304.208675:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecda expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.208705:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f200, rc 0) 00000100:00100000:2.0:1788802304.208778:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:10338:x1875694872197504:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 377us (676us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788802304.208785:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:2.0:1788802304.214629:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802304.214723:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872197632 00000100:00100000:3.0:1788802304.214743:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872197632 00000100:00100000:3.0:1788802304.214816:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:3.0:1788802304.214826:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:10338:x1875694872197632:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:3.0:1788802304.214913:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c127 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.214932:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.214944:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.214961:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c12e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.214968:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.214973:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215060:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215068:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215074:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802304.215116:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215128:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215140:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c127 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215147:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c127 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215153:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802304.215158:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c127 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215164:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c127 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215176:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:3.0:1788802304.215178:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802304.215181:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c127 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215185:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c127 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215195:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215198:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c12e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215202:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c12e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215205:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802304.215213:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c12e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215217:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c12e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215222:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d02e21800) 00010000:00010000:3.0:1788802304.215223:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802304.215226:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c12e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215231:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c12e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215299:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215304:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215307:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215310:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802304.215312:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215316:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215321:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802304.215322:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802304.215329:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.215333:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802304.215418:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:10338:x1875694872197632:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 594us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802304.215425:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:3.0:1788802304.221153:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802304.221984:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872197888 00000100:00100000:0.0:1788802304.221997:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872197888 00000100:00100000:0.0:1788802304.222064:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:0.0:1788802304.222076:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:10338:x1875694872197888:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788802304.222442:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10338:x1875694872197888:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 366us (1300us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788802304.222451:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788802304.279633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802304.279807:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872198144 00000100:00100000:3.0:1788802304.279817:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872198144 00000100:00100000:3.0:1788802304.279876:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:3.0:1788802304.279887:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10341:x1875694872198144:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802304.279912:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802304.279932:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c13c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edece1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.280013:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c143 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.280028:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c143 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.280042:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c143 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.280057:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c14a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.280065:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c14a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.280080:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c14a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.280198:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.280206:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.280213:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802304.283928:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788802304.284088:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c143 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284101:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c143 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284108:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c143 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284114:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802304.284119:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c143 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284127:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c143 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284143:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:3.0:1788802304.284147:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802304.284166:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c143 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284173:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c143 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284189:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c14a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284196:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c14a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284201:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c14a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284207:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802304.284210:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c14a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.284216:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c14a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.285999:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d02e21800) 00010000:00010000:3.0:1788802304.286004:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802304.286010:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c14a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.286018:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c14a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.286101:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c13c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edece1 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.286140:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edece1 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.286147:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802304.286150:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788802304.286153:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8e00, rc 0) 00000100:00100000:3.0:1788802304.286262:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10341:x1875694872198144:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 6377us (6638us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788802304.286271:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:2.0:1788802304.291320:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802304.291544:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872198272 00000100:00100000:3.0:1788802304.291557:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872198272 00000100:00100000:3.0:1788802304.291631:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:3.0:1788802304.291642:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10341:x1875694872198272:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:3.0:1788802304.291730:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c15f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.291757:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c15f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.291770:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c15f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.291806:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c15f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.291814:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c15f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.291839:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c15f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.291845:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802304.291849:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c15f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.291857:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c15f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.291869:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802304.291872:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788802304.291877:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c15f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.291883:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c15f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802304.291959:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10341:x1875694872198272:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 319us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802304.291967:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:1.0:1788802304.294175:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802304.294272:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872198528 00000100:00100000:3.0:1788802304.294282:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872198528 00000100:00100000:3.0:1788802304.294321:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788802304.294329:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10341:x1875694872198528:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802304.294540:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:10341:x1875694872198528:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 210us (373us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788802304.294548:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000001:00080000:3.0:1788802304.468498:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967328 is committed 00000004:00080000:3.0:1788802304.468517:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788802304.468963:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892155648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788802304.469051:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788802304.469300:0:11960:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910d08f74000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788802304.469310:0:11960:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d07391700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910d156cdb40 00000020:00080000:1.0:1788802304.469313:0:11960:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d07391500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910d3ef34800 00000001:00080000:1.0:1788802304.469353:0:11960:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000100:00100000:0.0:1788802304.470138:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892155648 00000100:00100000:0.0:1788802304.470154:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892155648 00000100:00100000:0.0:1788802304.470234:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788802304.470324:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892155648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788802304.470361:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788802304.470397:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ef4ff, atime: 0x6a9ef4ff, ctime: 0x6a9ef4ff, blocks: 0x1 00010000:00010000:0.0:1788802304.470405:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c166 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.470423:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1788802304.470428:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802304.470435:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.470452:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.470462:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.470471:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802304.470539:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788802304.471167:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875694892155648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 844us (2116us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788802304.471178:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00080000:0.0:1788802304.471216:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:1.0:1788802304.471313:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d082f6d80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788802304.471329:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892155648:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1788802304.471349:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1788802304.473339:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802304.473353:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.473368:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802304.473373:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.473385:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.473409:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c166 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.473417:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c166 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.473447:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802304.473449:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802304.473450:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802304.621784:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802304.621904:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872198784 00000100:00100000:1.0:1788802304.621920:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872198784 00000100:00100000:1.0:1788802304.622013:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:1.0:1788802304.622025:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:10372:x1875694872198784:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:1.0:1788802304.622085:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802304.622117:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c16d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edece8 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.622618:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c174 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.622639:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.622655:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802304.622670:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788802304.623413:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c16d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edece8 expref: 15 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.623673:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c174 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edece8 expref: 14 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.623758:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:1.0:1788802304.623762:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802304.623767:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3e00, rc 0) 00000100:00100000:1.0:1788802304.623955:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10372:x1875694872198784:12345-192.168.201.57@tcp:101:cat.0 Request processed in 1930us (2187us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788802304.623965:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:2.0:1788802304.631491:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802304.631643:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872198912 00000100:00100000:1.0:1788802304.631665:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872198912 00000100:00100000:1.0:1788802304.631764:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:1.0:1788802304.631793:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:2358:x1875694872198912:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802304.631815:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802304.631846:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c174 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edece8 expref: 14 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.631872:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:1.0:1788802304.631878:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802304.631964:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:2358:x1875694872198912:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 174us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802304.631972:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:3.0:1788802304.635948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802304.636305:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872199168 00000100:00100000:0.0:1788802304.636324:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872199168 00000100:00100000:0.0:1788802304.636413:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:0.0:1788802304.636424:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:10372:x1875694872199168:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:0.0:1788802304.636815:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10372:x1875694872199168:12345-192.168.201.57@tcp:35:cat.0 Request processed in 390us (888us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788802304.636823:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:0.0:1788802304.697335:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802304.697479:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872199424 00000100:00100000:3.0:1788802304.697492:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872199424 00000100:00100000:3.0:1788802304.697559:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:3.0:1788802304.697570:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10378:x1875694872199424:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:3.0:1788802304.697599:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802304.697602:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788802304.697629:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c0d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecbe expref: 14 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.697662:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:3.0:1788802304.697668:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802304.697682:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c182 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edecef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.697828:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.697845:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edece1 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.697855:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.698175:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edece1 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.698210:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edece1 expref: 14 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802304.698225:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892155776:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802304.698409:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d01370d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788802304.703032:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802304.703288:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee2c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892155776:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802304.703318:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802304.703437:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872199552 00000100:00100000:1.0:1788802304.703446:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872199552 00010000:00010000:1.0:1788802304.703494:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edece1 expref: 15 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802304.703539:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:1.0:1788802304.703548:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:2359:x1875694872199552:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802304.703564:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802304.703571:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edece1 expref: 15 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.703583:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edece1 expref: 15 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.703608:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c151 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edece1 expref: 15 pid: 5844 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.703640:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:1.0:1788802304.703645:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.703655:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.703662:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.703694:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802304.704015:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.704023:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802304.704048:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788802304.704409:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c182 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecef expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.704429:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecef expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.704437:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802304.704440:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788802304.704443:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8a00, rc 0) 00000100:00100000:1.0:1788802304.704683:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:2359:x1875694872199552:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 1134us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802304.704693:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:2.0:1788802304.704770:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10378:x1875694872199424:12345-192.168.201.57@tcp:101:dd.0 Request processed in 7201us (7445us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788802304.704778:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:0.0:1788802304.707961:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802304.708128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872199808 00000100:00100000:3.0:1788802304.708139:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872199808 00000100:00100000:3.0:1788802304.708410:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:3.0:1788802304.708425:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10378:x1875694872199808:12345-192.168.201.57@tcp:36:dd.0 00010000:00010000:3.0:1788802304.708731:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.708751:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802304.708763:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788802304.708818:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788802304.708841:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e6f2cc9 reply state 000000001084d415 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802304.708850:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788802304.708973:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:10378:x1875694872199808:12345-192.168.201.57@tcp:36:dd.0 Request processed in 551us (1022us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788802304.708981:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00000020:00080000:3.0:1788802304.708986:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788802304.714375:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.714393:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.714401:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.714408:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802304.714412:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.714420:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.714526:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802304.714530:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802304.714536:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.714542:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c197 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802304.871042:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802304.871183:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872199936 00000100:00100000:1.0:1788802304.871196:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872199936 00000100:00100000:1.0:1788802304.871450:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:1.0:1788802304.871463:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:10392:x1875694872199936:12345-192.168.201.57@tcp:101:stat.0 00010000:00010000:1.0:1788802304.871497:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802304.871527:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c19e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edecf6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.871621:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c1a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.871637:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.871648:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.871692:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.871698:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.871702:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.872055:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.872065:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecef expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.872071:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.872112:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecef expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.872125:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecef expref: 17 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802304.872144:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892155904:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802304.872300:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d167b0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788802304.874583:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802304.874694:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872200192 00000100:00100000:2.0:1788802304.874706:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872200192 00000100:00100000:2.0:1788802304.874783:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788802304.874795:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:5599:x1875694872200192:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788802304.875573:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:5599:x1875694872200192:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 776us (1008us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788802304.875583:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788802304.875898:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892155904:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802304.875936:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802304.877774:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802304.878017:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872200320 00000100:00100000:1.0:1788802304.878030:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872200320 00010000:00010000:1.0:1788802304.878081:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecef expref: 19 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802304.878123:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:1.0:1788802304.878144:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:2359:x1875694872200320:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802304.878164:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802304.878171:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecef expref: 19 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.878191:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecef expref: 19 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.878216:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c189 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecef expref: 19 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.878234:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:1.0:1788802304.878281:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.878294:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.878304:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.878342:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802304.878367:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878376:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802304.878439:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788802304.878445:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802304.878503:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878519:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878541:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c1a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878550:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c1a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878558:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878565:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802304.878570:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c1a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878578:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c1a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878589:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:2.0:1788802304.878592:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802304.878596:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c1a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878603:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c1a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878617:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878623:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878628:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878639:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802304.878642:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878649:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878658:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d05184f00) 00010000:00010000:2.0:1788802304.878661:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802304.878664:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878670:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878843:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c19e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecf6 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878859:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecf6 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.878867:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802304.878869:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802304.878872:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2600, rc 0) 00000100:00100000:2.0:1788802304.879005:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:10392:x1875694872199936:12345-192.168.201.57@tcp:101:stat.0 Request processed in 7545us (7976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802304.879006:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:2359:x1875694872200320:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 862us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802304.879015:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:1.0:1788802304.879015:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788802304.918277:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802304.918424:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872200576 00000100:00100000:1.0:1788802304.918437:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872200576 00000100:00100000:1.0:1788802304.918520:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:1.0:1788802304.918533:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:10398:x1875694872200576:12345-192.168.201.57@tcp:36:truncate.0 00010000:00010000:1.0:1788802304.918633:0:9415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802304.918683:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecf6 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.918703:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:1.0:1788802304.918708:0:9415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802304.919015:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.919029:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802304.919037:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788802304.919085:0:9415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788802304.919102:0:9415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a027bb7c reply state 00000000ac79fbe5 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802304.919110:0:9415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788802304.919310:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10398:x1875694872200576:12345-192.168.201.57@tcp:36:truncate.0 Request processed in 777us (1078us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788802304.919318:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 54 00000020:00080000:1.0:1788802304.919344:0:9415:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788802304.921378:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.921417:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.921426:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.921434:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802304.921440:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.921449:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.921472:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802304.921475:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802304.921482:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802304.921488:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c1ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802305.050316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802305.051664:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872200704 00000100:00100000:2.0:1788802305.052054:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872200704 00000100:00080000:3.0:1788802305.053019:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802305.053082:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:2.0:1788802305.053100:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:10412:x1875694872200704:12345-192.168.201.57@tcp:101:stat.0 00010000:00010000:2.0:1788802305.053147:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802305.053190:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c1c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edecfd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.053314:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c1c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.053428:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c1c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.053611:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c1c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.053633:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c1cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.053641:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.053650:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054093:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054105:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054114:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802305.054164:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788802305.054170:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802305.054197:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054212:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054235:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c1c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054285:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c1c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054293:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054300:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802305.054306:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054315:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c1c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054332:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:2.0:1788802305.054336:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802305.054354:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c1c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054362:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c1c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054378:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054385:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c1cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054391:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c1cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054402:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ec00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802305.054405:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c1cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054412:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c1cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054420:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d2166a000) 00010000:00010000:2.0:1788802305.054423:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802305.054426:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c1cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.054432:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c1cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.057882:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c1c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecfd expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.057930:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecfd expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.057941:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802305.057945:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802305.057950:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95fc00, rc 0) 00000100:00100000:2.0:1788802305.058069:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10412:x1875694872200704:12345-192.168.201.57@tcp:101:stat.0 Request processed in 4972us (7764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802305.058080:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00010000:00010000:1.0:1788802305.109628:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802305.146010:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.146153:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872200960 00000100:00100000:3.0:1788802305.146168:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872200960 00000100:00100000:3.0:1788802305.146340:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:3.0:1788802305.146356:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10422:x1875694872200960:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802305.146389:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802305.146423:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c1dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded04 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802305.146568:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788802305.146783:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c1dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded04 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.146801:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8300) 00010000:00010000:3.0:1788802305.146804:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788802305.146811:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c1dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded04 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.146829:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9e00, rc 0) 00000100:00100000:3.0:1788802305.146916:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:10422:x1875694872200960:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 565us (921us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788802305.146927:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:0.0:1788802305.151525:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.151619:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872201216 00000100:00100000:3.0:1788802305.151633:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872201216 00000100:00100000:3.0:1788802305.151715:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:3.0:1788802305.151736:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:10422:x1875694872201216:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802305.152080:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10422:x1875694872201216:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 346us (570us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788802305.152089:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:0.0:1788802305.236368:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802305.236495:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872201472 00000100:00100000:1.0:1788802305.236511:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872201472 00000100:00100000:1.0:1788802305.236711:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:1.0:1788802305.236735:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10428:x1875694872201472:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788802305.237012:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802305.237048:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded0b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.237360:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.237380:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecfd expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.237391:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.237435:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecfd expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.237453:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecfd expref: 22 pid: 5843 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802305.237470:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892156032:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802305.237808:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d167b0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788802305.246690:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892156032:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802305.246745:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802305.247479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.247750:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872201600 00000100:00100000:3.0:1788802305.247832:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872201600 00010000:00010000:3.0:1788802305.247894:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecfd expref: 23 pid: 5843 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802305.248109:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:3.0:1788802305.248122:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:2359:x1875694872201600:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802305.248148:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802305.248157:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecfd expref: 23 pid: 5843 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.248172:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecfd expref: 23 pid: 5843 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.248202:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c1d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edecfd expref: 23 pid: 5843 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.248222:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802305.248228:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.248313:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.248323:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.248364:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802305.248441:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:2359:x1875694872201600:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 320us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802305.248450:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00010000:00010000:2.0:1788802305.248781:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.248800:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802305.248826:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788802305.249058:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c1eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded0b expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.249079:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded0b expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.249087:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802305.249090:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788802305.249092:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3400, rc 0) 00000100:00100000:2.0:1788802305.249143:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:10428:x1875694872201472:12345-192.168.201.57@tcp:101:bash.0 Request processed in 12414us (12796us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788802305.249154:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:0.0:1788802305.253424:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802305.253619:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872201856 00000100:00100000:1.0:1788802305.253635:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872201856 00000100:00100000:1.0:1788802305.253876:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:1.0:1788802305.253890:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:10428:x1875694872201856:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:1.0:1788802305.254458:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.254481:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.254496:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788802305.255222:0:9415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788802305.255370:0:9415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be7ccc28 reply state 0000000046a7532f transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802305.255384:0:9415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788802305.255531:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:10428:x1875694872201856:12345-192.168.201.57@tcp:36:bash.0 Request processed in 1640us (2117us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788802305.255541:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00000020:00080000:1.0:1788802305.257482:0:9415:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788802305.262038:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.262063:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.262073:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.262081:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802305.262087:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.262123:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.262147:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802305.262150:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802305.262157:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.262165:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c200 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802305.263393:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802305.263611:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872201984 00000100:00100000:2.0:1788802305.263628:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872201984 00000100:00100000:2.0:1788802305.263732:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:2.0:1788802305.263744:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:10428:x1875694872201984:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788802305.263778:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802305.263807:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c207 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded12 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.263921:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.263940:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded0b expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.263950:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.263994:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded0b expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.264030:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded0b expref: 25 pid: 5842 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802305.264046:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892156160:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802305.264165:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08a65180 going to sleep for 11 seconds 00000100:00100000:2.0:1788802305.268015:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892156160:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802305.268061:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802305.270186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802305.270432:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872202112 00000100:00100000:2.0:1788802305.270450:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872202112 00010000:00010000:2.0:1788802305.270541:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded0b expref: 26 pid: 5842 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802305.270602:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:2.0:1788802305.270615:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:2360:x1875694872202112:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802305.270634:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802305.270652:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded0b expref: 26 pid: 5842 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.270668:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded0b expref: 26 pid: 5842 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.270708:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c1f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded0b expref: 26 pid: 5842 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.270770:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802305.270777:0:7624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.270788:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.270797:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.270835:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802305.270921:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:2360:x1875694872202112:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 302us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802305.270929:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00010000:00010000:3.0:1788802305.272725:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.272749:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802305.272829:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788802305.272835:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802305.272868:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.273098:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c207 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded12 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.273127:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded12 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.273140:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802305.273144:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788802305.273171:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95ec00, rc 0) 00000100:00100000:3.0:1788802305.273393:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:10428:x1875694872201984:12345-192.168.201.57@tcp:101:bash.0 Request processed in 9649us (10013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802305.273403:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:0.0:1788802305.279835:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.279998:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872202368 00000100:00100000:3.0:1788802305.280011:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872202368 00000100:00100000:3.0:1788802305.280131:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788802305.280146:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:10428:x1875694872202368:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:3.0:1788802305.280890:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:10428:x1875694872202368:12345-192.168.201.57@tcp:35:bash.0 Request processed in 741us (1065us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788802305.280904:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:0.0:1788802305.373401:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.373558:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872202624 00000100:00100000:3.0:1788802305.373573:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872202624 00000100:00100000:3.0:1788802305.373652:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:3.0:1788802305.373666:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:10438:x1875694872202624:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802305.373701:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802305.373740:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded19 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802305.373871:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788802305.374047:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c215 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded19 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.374064:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8300) 00010000:00010000:3.0:1788802305.374068:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788802305.374074:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded19 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.374114:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9e00, rc 0) 00000100:00100000:3.0:1788802305.374197:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:10438:x1875694872202624:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 534us (812us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788802305.374204:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:0.0:1788802305.380771:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802305.380942:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872202752 00000100:00100000:1.0:1788802305.380957:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872202752 00000100:00100000:1.0:1788802305.381044:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:1.0:1788802305.381058:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:10438:x1875694872202752:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:1.0:1788802305.381192:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c223 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381288:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381308:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381327:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c22a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381333:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c22a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381337:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c22a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381733:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381744:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381752:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788802305.381814:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381832:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381841:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c223 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381860:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381867:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802305.381873:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381883:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c223 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381902:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802305.381906:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802305.381911:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381918:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381938:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c22a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381945:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c22a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381952:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c22a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381956:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802305.381960:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c22a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381976:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c22a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381984:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d05184b00) 00010000:00010000:1.0:1788802305.381987:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802305.381990:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c22a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.381996:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c22a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.382013:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.382018:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.382022:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.382025:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802305.382026:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.382030:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.382034:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:1.0:1788802305.382035:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802305.382037:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.382050:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802305.382134:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:10438:x1875694872202752:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 1079us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802305.382140:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:0.0:1788802305.387226:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802305.387309:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872203008 00000100:00100000:1.0:1788802305.387324:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872203008 00000100:00100000:1.0:1788802305.387404:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:1.0:1788802305.387418:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:10438:x1875694872203008:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788802305.387765:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:10438:x1875694872203008:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 349us (566us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788802305.387775:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:1.0:1788802305.420711:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788802305.420756:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d358bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892156288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802305.420860:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802305.421091:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892156288 00000100:00100000:3.0:1788802305.421105:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892156288 00000100:00100000:3.0:1788802305.421192:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788802305.421205:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875694892156288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788802305.421292:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802305.421360:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875694892156288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802305.421368:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788802305.421915:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d358bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892156288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802305.428955:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.429054:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872203264 00000100:00100000:3.0:1788802305.429069:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872203264 00000100:00100000:3.0:1788802305.429212:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:3.0:1788802305.429225:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:10441:x1875694872203264:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802305.429324:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802305.429354:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c238 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded20 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.429627:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c23f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.429657:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c23f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.429703:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c23f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.429735:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.429742:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.429750:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.430187:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c24d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.430199:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c24d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.430208:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c24d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802305.430222:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788802305.430412:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c23f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.430421:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c23f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.430430:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c23f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.430437:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802305.431371:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c23f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431384:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c23f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431405:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:3.0:1788802305.431409:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802305.431415:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c23f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431423:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c23f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431793:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431802:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c246 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431809:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431816:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802305.431819:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431826:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c246 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431837:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d02e21800) 00010000:00010000:3.0:1788802305.431839:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802305.431850:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c246 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431857:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431954:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c238 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded20 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431970:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c24d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded20 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.431977:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802305.431980:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788802305.431982:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8600, rc 0) 00000100:00100000:3.0:1788802305.432145:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:10441:x1875694872203264:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 2921us (3204us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788802305.432157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:0.0:1788802305.436888:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802305.437071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802305.437183:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872203520 00000100:00100000:2.0:1788802305.437198:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872203520 00000100:00100000:2.0:1788802305.437322:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788802305.437336:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:2358:x1875694872203520:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802305.437356:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802305.437392:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c24d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded20 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.437418:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802305.437424:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802305.437828:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:2358:x1875694872203520:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 493us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802305.437838:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:1.0:1788802305.439229:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872203392 00000100:00100000:1.0:1788802305.439341:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872203392 00000100:00100000:1.0:1788802305.439458:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:1.0:1788802305.439470:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:10441:x1875694872203392:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:1.0:1788802305.439564:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c25b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.439588:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.439620:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.439669:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.439678:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c25b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.439685:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c25b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.439692:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802305.439697:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c25b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.439705:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c25b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.439726:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:1.0:1788802305.439730:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788802305.439736:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c25b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.439743:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c25b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802305.439834:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:10441:x1875694872203392:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 366us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802305.439843:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:0.0:1788802305.442435:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.442650:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872203776 00000100:00100000:3.0:1788802305.442666:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872203776 00000100:00100000:3.0:1788802305.442747:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788802305.442761:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:10441:x1875694872203776:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802305.443351:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:10441:x1875694872203776:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 589us (930us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788802305.443361:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:0.0:1788802305.526566:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802305.526662:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802305.526702:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.526856:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872204160 00000100:00100000:3.0:1788802305.526872:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872204160 00000100:00100000:3.0:1788802305.526970:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 139 00000100:00100000:3.0:1788802305.526983:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872204160:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802305.527085:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872204160:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 105us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802305.527094:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 139 00000100:00080000:0.0:1788802305.527224:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802305.527757:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872203904 00000100:00100000:1.0:1788802305.527774:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872203904 00000100:00100000:1.0:1788802305.527819:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 290 00000100:00100000:1.0:1788802305.527827:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872203904:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802305.527884:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872203904:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 58us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802305.527891:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 290 00000100:00100000:2.0:1788802305.528036:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872204032 00000100:00100000:2.0:1788802305.528041:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872204032 00000100:00100000:2.0:1788802305.528091:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00100000:2.0:1788802305.528098:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872204032:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802305.528128:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872204032:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 31us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802305.528135:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00080000:1.0:1788802305.528311:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802305.602151:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.602287:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872204416 00000100:00100000:3.0:1788802305.602302:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872204416 00000100:00100000:3.0:1788802305.602382:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:3.0:1788802305.602396:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:10460:x1875694872204416:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:3.0:1788802305.602438:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802305.602470:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c262 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded27 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.602659:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c269 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.602680:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c269 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.602694:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c269 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802305.602719:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788802305.602923:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c262 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded27 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.602946:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c269 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded27 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.602957:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802305.602968:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788802305.602978:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9400, rc 0) 00000100:00100000:3.0:1788802305.603061:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10460:x1875694872204416:12345-192.168.201.57@tcp:101:cat.0 Request processed in 668us (927us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788802305.603069:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:0.0:1788802305.625935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.626102:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872204544 00000100:00100000:3.0:1788802305.626117:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872204544 00000100:00100000:3.0:1788802305.626209:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:3.0:1788802305.626222:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10461:x1875694872204544:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802305.626314:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802305.626345:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded2e expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.626442:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c27e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.626461:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.626476:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802305.626520:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788802305.626525:0:9415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802305.626547:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.626582:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded2e expref: 33 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.626632:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c27e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded2e expref: 32 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.626643:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:3.0:1788802305.626647:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788802305.626652:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8400, rc 0) 00000100:00100000:3.0:1788802305.626749:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10461:x1875694872204544:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 529us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802305.626757:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:0.0:1788802305.637310:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.637523:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872204928 00000100:00100000:3.0:1788802305.637537:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872204928 00000100:00100000:3.0:1788802305.637610:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:3.0:1788802305.637622:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10461:x1875694872204928:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788802305.638855:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10461:x1875694872204928:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 1223us (1668us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788802305.638870:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:2.0:1788802305.641305:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802305.641401:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872205056 00000100:00100000:1.0:1788802305.641414:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872205056 00000100:00100000:1.0:1788802305.641508:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:1.0:1788802305.641525:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10461:x1875694872205056:12345-192.168.201.57@tcp:103:lfs.0 00010000:00010000:1.0:1788802305.641546:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788802305.641589:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c20e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded12 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.641618:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c269 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded27 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.641632:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c112 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edecd3 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.641641:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21600) 00010000:00010000:1.0:1788802305.641653:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802305.641739:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:10461:x1875694872205056:12345-192.168.201.57@tcp:103:lfs.0 Request processed in 221us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802305.641749:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:0.0:1788802305.643911:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.644085:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872205184 00000100:00100000:3.0:1788802305.644099:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872205184 00000100:00100000:3.0:1788802305.644191:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00100000:3.0:1788802305.644205:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:10461:x1875694872205184:12345-192.168.201.57@tcp:58:lfs.0 00010000:00010000:3.0:1788802305.644438:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c285 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.644589:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c285 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.644604:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c285 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788802305.645764:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788802305.645963:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788802305.646030:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788802305.646195:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:10461:x1875694872205184:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 1985us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802305.646208:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00100000:0.0:1788802305.685862:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.686487:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872205312 00000100:00100000:3.0:1788802305.686517:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872205312 00000100:00100000:2.0:1788802305.686971:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:2.0:1788802305.686987:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:10463:x1875694872205312:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802305.687024:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802305.687059:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c28c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded35 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687179:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c293 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687209:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c293 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687275:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c293 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687297:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c29a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687305:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687313:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687740:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687752:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687759:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802305.687808:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788802305.687814:0:9415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802305.687838:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687851:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.687993:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c293 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688014:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c293 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688022:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c293 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688029:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802305.688035:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c293 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688044:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c293 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688060:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:2.0:1788802305.688063:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802305.688070:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c293 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688078:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c293 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688169:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688185:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c29a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688193:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c29a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688198:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ec00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802305.688211:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c29a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688218:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c29a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688226:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d2166a000) 00010000:00010000:2.0:1788802305.688229:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802305.688233:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c29a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688307:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c29a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688356:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c28c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded35 expref: 32 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688373:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded35 expref: 31 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.688382:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21800) 00010000:00010000:2.0:1788802305.688385:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802305.688388:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f200, rc 0) 00000100:00100000:2.0:1788802305.688947:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10463:x1875694872205312:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1958us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802305.688956:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 67 00000040:00080000:3.0:1788802305.934235:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802305.935028:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802305.935140:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788802305.935150:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788802305.935877:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee2dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892156416:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788802305.937418:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d01370e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802305.945159:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee2dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892156416:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788802305.954133:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.954498:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872205440 00000100:00100000:3.0:1788802305.954513:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872205440 00000100:00100000:3.0:1788802305.954592:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:3.0:1788802305.954607:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10474:x1875694872205440:12345-192.168.201.57@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788802305.954743:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10474:x1875694872205440:12345-192.168.201.57@tcp:900:lhsmtool_posix.0 Request processed in 139us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802305.954753:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:0.0:1788802305.957420:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802305.957724:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872205568 00000100:00100000:1.0:1788802305.957742:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872205568 00000100:00100000:1.0:1788802305.957870:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:1.0:1788802305.957882:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10474:x1875694872205568:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788802305.957935:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788802305.958094:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10474:x1875694872205568:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 213us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802305.958103:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:0.0:1788802305.961574:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.961807:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872205696 00000100:00100000:3.0:1788802305.961822:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872205696 00000100:00100000:3.0:1788802305.961901:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:3.0:1788802305.961914:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10474:x1875694872205696:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788802305.962025:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c2a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962047:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962065:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962313:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962324:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962333:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962368:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962377:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962384:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802305.962429:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788802305.962434:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802305.962453:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962467:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962474:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c2a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962481:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962501:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802305.962508:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962517:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c2a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962533:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:3.0:1788802305.962536:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802305.962542:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c2a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962549:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c2a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962565:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962572:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962578:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962584:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802305.962587:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962592:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962610:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff910d02e21700) 00010000:00010000:3.0:1788802305.962613:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802305.962616:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962623:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962639:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962645:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962651:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962656:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802305.962659:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962665:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962671:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21800) 00010000:00010000:3.0:1788802305.962673:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802305.962675:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802305.962681:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802305.962790:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10474:x1875694872205696:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 878us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802305.962799:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:0.0:1788802305.966630:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802305.968235:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872205952 00000100:00100000:2.0:1788802305.968360:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872205952 00000100:00100000:2.0:1788802305.968449:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:2.0:1788802305.968463:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10474:x1875694872205952:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802305.969137:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802305.969175:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c2bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded3c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.969341:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c2c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.969361:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.969379:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802305.969394:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788802305.969546:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.969556:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c2c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.969564:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.969570:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ec00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802305.969575:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.969584:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c2c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.969600:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21800) 00010000:00010000:2.0:1788802305.969617:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802305.969625:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c2c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.969633:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c2c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.969698:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c2bd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded3c expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.970183:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:2.0:1788802305.970186:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788802305.970192:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c2bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded3c expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802305.970206:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f400, rc 0) 00000100:00100000:2.0:1788802305.970416:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10474:x1875694872205952:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1954us (3798us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788802305.970428:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:0.0:1788802305.977802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802305.978065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872206080 00000100:00100000:3.0:1788802305.978080:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872206080 00000100:00100000:3.0:1788802305.978352:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 71 00000100:00100000:3.0:1788802305.978368:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10474:x1875694872206080:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788802305.978431:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788802305.978579:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10474:x1875694872206080:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 216us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802305.978588:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 71 00000100:00100000:2.0:1788802305.986092:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802305.986384:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872206336 00000100:00100000:1.0:1788802305.986401:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872206336 00000100:00100000:1.0:1788802305.986482:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 72 00000100:00100000:1.0:1788802305.986496:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10474:x1875694872206336:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788802305.986528:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802305.986532:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788802305.986572:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c27e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded2e expref: 32 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.986600:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802305.986607:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802305.986626:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c2d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded43 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788802305.989800:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788802305.991691:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c2d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.991733:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.991765:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.991864:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c2d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded43 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.991889:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded43 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802305.991900:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d05184b00) 00010000:00010000:1.0:1788802305.991904:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802305.991908:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3600, rc 0) 00000100:00100000:1.0:1788802305.993159:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10474:x1875694872206336:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 6653us (7071us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788802305.993174:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 72 00000100:00100000:3.0:1788802305.999665:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802305.999831:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872206592 00000100:00100000:1.0:1788802305.999850:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872206592 00000100:00100000:1.0:1788802305.999954:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:1.0:1788802305.999967:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10474:x1875694872206592:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788802306.000065:0:9415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802306.000106:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c2d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded43 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.000134:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d05184b00) 00010000:00010000:1.0:1788802306.000150:0:9415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802306.000183:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c2e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.000219:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c2e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.000232:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c2e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.000532:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c2ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf798bca0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.000563:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf798bca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.001767:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf798bca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002012:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c2e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002020:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c2e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002028:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c2e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002034:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802306.002039:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c2e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002047:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c2e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002061:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802306.002073:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802306.002080:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c2e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002086:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c2e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002100:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf798bca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002106:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c2ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf798bca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002111:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c2ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf798bca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002116:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802306.002119:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c2ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf798bca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002125:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c2ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf798bca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002133:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf798bca0 (ffff910d05184100) 00010000:00010000:1.0:1788802306.002135:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802306.002138:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c2ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf798bca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.002143:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c2ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf798bca0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802306.002285:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10474:x1875694872206592:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 2315us (2635us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788802306.002301:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:0.0:1788802306.009634:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802306.009895:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872206720 00000100:00100000:3.0:1788802306.009913:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872206720 00000100:00100000:3.0:1788802306.010030:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:3.0:1788802306.010043:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10474:x1875694872206720:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788802306.010076:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802306.010113:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded4a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.010170:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.010201:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.010217:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.010404:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c2f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded4a expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.010427:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded4a expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.010438:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d02e21700) 00010000:00010000:3.0:1788802306.010442:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788802306.010446:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9000, rc 0) 00000100:00100000:3.0:1788802306.010535:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10474:x1875694872206720:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 494us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802306.010545:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:0.0:1788802306.037067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802306.037530:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872206976 00000100:00100000:3.0:1788802306.037547:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872206976 00000100:00100000:3.0:1788802306.037635:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:3.0:1788802306.037647:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10474:x1875694872206976:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788802306.037775:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.037796:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.037813:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788802306.038465:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788802306.038482:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358985242446ns, next at 359985239368ns, rc = 0 00000004:00010000:3.0:1788802306.039122:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025a6b327 reply state 00000000765d285c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802306.039138:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788802306.039321:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:10474:x1875694872206976:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 1669us (2264us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788802306.039332:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:2.0:1788802306.046415:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802306.046808:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872207104 00000100:00100000:0.0:1788802306.046824:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872207104 00000100:00100000:0.0:1788802306.046912:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00100000:0.0:1788802306.046934:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:10474:x1875694872207104:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802306.046986:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802306.047018:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c30a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded51 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.047115:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c30a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded51 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.047136:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c30a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded51 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.047184:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d02e21700) 00010000:00010000:0.0:1788802306.047189:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788802306.047194:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1000, rc 0) 00000100:00100000:0.0:1788802306.047313:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:10474:x1875694872207104:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 390us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802306.047320:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 76 00010000:00010000:3.0:1788802306.047953:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.047979:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.047988:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.047997:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802306.048004:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.048015:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.048313:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d02e21700) 00010000:00010000:3.0:1788802306.048317:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788802306.048322:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.048330:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c303 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802306.060340:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.060467:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872207232 00000100:00100000:1.0:1788802306.060483:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872207232 00000100:00100000:1.0:1788802306.060572:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:1.0:1788802306.060584:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875694872207232:12345-192.168.201.57@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788802306.060643:0:8127:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:1.0:1788802306.060688:0:8127:0:(genops.c:1384:class_connect()) connect: client df790e2a-6b5b-4b00-92e8-29e1cf7bde69, cookie 0x6ecba1490fc9c311 00002000:00100000:1.0:1788802306.060714:0:8127:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df790e2a-6b5b-4b00-92e8-29e1cf7bde69/ffff910d08aa7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788802306.060747:0:8127:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788802306.061297:0:8127:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788802306.061342:0:8127:0:(import.c:65:import_set_state_nolock()) ffff910d08aa6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788802306.061440:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2356:x1875694872207232:12345-192.168.201.57@tcp:8:lhsmtool_posix.0 Request processed in 855us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802306.061451:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:0.0:1788802306.064233:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802306.064404:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872207360 00000100:00100000:2.0:1788802306.064417:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872207360 00000100:00100000:2.0:1788802306.064512:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:2.0:1788802306.064526:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:0:x1875694872207360:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788802306.065201:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788802306.117288:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:0:x1875694872207360:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 52745us (53044us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788802306.117307:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 00000001:00100000:2.0:1788802306.117369:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000001:00080000:2.0:1788802306.117387:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:1.0:1788802306.127056:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802306.132610:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802306.132861:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872207616 00000100:00100000:3.0:1788802306.132917:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872207616 00000100:00100000:3.0:1788802306.133011:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788802306.133025:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:10474:x1875694872207616:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788802306.133441:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:10474:x1875694872207616:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 417us (852us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788802306.133451:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:0.0:1788802306.135651:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.135750:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872207872 00000100:00100000:1.0:1788802306.135766:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872207872 00000100:00100000:1.0:1788802306.135846:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 77 00000100:00100000:1.0:1788802306.135859:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:10474:x1875694872207872:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788802306.136040:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:10474:x1875694872207872:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 182us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802306.136049:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 77 00000100:00100000:3.0:1788802306.143005:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.144600:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872208000 00000100:00100000:1.0:1788802306.144617:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872208000 00000100:00100000:1.0:1788802306.144692:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:1.0:1788802306.144715:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:10474:x1875694872208000:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788802306.144743:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802306.144771:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c318 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded58 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.144860:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c31f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.144878:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.144894:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802306.144941:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802306.144964:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.144996:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c318 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded58 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.145015:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c31f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded58 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.145025:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d02e21700) 00010000:00010000:1.0:1788802306.145029:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788802306.145033:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2e00, rc 0) 00000100:00100000:1.0:1788802306.145143:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:10474:x1875694872208000:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 442us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802306.145151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:0.0:1788802306.155712:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802306.155798:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872208128 00000100:00100000:2.0:1788802306.155813:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872208128 00000100:00100000:2.0:1788802306.155893:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:2.0:1788802306.155972:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872208128:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802306.156001:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802306.156030:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c326 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded5f expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788802306.156069:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ef501, blocks: 0x1 00010000:00010000:2.0:1788802306.156095:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1788802306.156102:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802306.156112:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c326 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded5f expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802306.156135:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c326 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded5f expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802306.156151:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f000, rc 0) 00000100:00100000:2.0:1788802306.156804:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872208128:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 895us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802306.156816:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:2.0:1788802306.166738:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802306.166782:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872208384 00000100:00100000:3.0:1788802306.166795:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872208384 00000100:00100000:3.0:1788802306.166879:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788802306.166893:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:10474:x1875694872208384:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788802306.167306:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:10474:x1875694872208384:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 414us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802306.167315:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788802306.171621:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802306.171684:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872208512 00000100:00100000:3.0:1788802306.171697:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872208512 00000100:00100000:3.0:1788802306.171774:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:3.0:1788802306.171787:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:10474:x1875694872208512:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788802306.171812:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802306.171840:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded66 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.171881:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c326 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded5f expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.173278:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802306.173287:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802306.173302:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.173366:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c326 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded5f expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.173392:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c326 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded5f expref: 7 pid: 6687 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802306.173414:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875694892156544:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802306.173570:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d02e2c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788802306.176849:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875694892156544:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802306.176915:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.176942:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9200, rc 0) 00000100:00100000:3.0:1788802306.177026:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:10474:x1875694872208512:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 5239us (5420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802306.177036:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:3.0:1788802306.182827:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.182923:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872208640 00000100:00100000:1.0:1788802306.182938:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872208640 00010000:00010000:1.0:1788802306.182998:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c326 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded5f expref: 7 pid: 6687 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802306.183057:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:1.0:1788802306.183072:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08319c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872208640:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802306.183092:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802306.183124:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c326 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded5f expref: 7 pid: 6687 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.183141:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c326 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded5f expref: 7 pid: 6687 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.183176:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c326 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded5f expref: 7 pid: 6687 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.183197:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802306.183202:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802306.183213:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.183225:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.187067:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802306.187102:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1875694892156672:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788802306.187274:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788802306.198622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802306.198674:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872208768 00000100:00100000:0.0:1788802306.198686:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872208768 00002000:00100000:0.0:1788802306.198764:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff910d33db7480 x1875694872208768/t0(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:447/0 lens 504/0 e 0 to 0 dl 1788802317 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788802306.198779:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d33db7480 with x1875694872208768 ext(0->8) 00002000:00010000:0.0:1788802306.198788:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d33db7480 00000100:00100000:0.0:1788802306.198819:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:0.0:1788802306.198830:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872208768:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788802306.199021:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1875694892156672:192.168.201.57@tcp:105: 00010000:00010000:1.0:1788802306.199054:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802306.199136:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08319c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872208640:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 16068us (16326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802306.199146:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:0.0:1788802306.204138:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872208768:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 Request processed in 5298us (5521us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788802306.204155:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00002000:00100000:0.0:1788802306.204169:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff910d33db7480 x1875694872208768/t4294967302(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:447/0 lens 504/448 e 0 to 0 dl 1788802317 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788802306.204181:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d33db7480 with x1875694872208768 ext(0->8) 00002000:00010000:0.0:1788802306.204189:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d33db7480 00000100:00100000:1.0:1788802306.208371:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802306.208751:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872208896 00000100:00100000:2.0:1788802306.208764:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872208896 00000100:00100000:2.0:1788802306.208827:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:2.0:1788802306.208849:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:10474:x1875694872208896:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788802306.273094:0:11960:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967332 is committed 00000020:00080000:1.0:1788802306.273126:0:11960:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1788802306.273143:0:11960:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1788802306.273181:0:11960:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788802306.273191:0:11960:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788802306.273273:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788802306.273286:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788802306.273453:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788802306.273480:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892156800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788802306.273584:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802306.273776:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892156800 00000100:00100000:3.0:1788802306.273788:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892156800 00000100:00100000:3.0:1788802306.273886:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788802306.273903:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:10474:x1875694872208896:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 65054us (65540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802306.273914:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00080000:1.0:1788802306.273981:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788802306.274431:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892156800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788802306.274679:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788802306.275357:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788802306 00002000:00010000:3.0:1788802306.275364:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788802306.275367:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788802305 -> 1788802306 00002000:00010000:3.0:1788802306.275370:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788802306.275469:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875694892156800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1569us (1881us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788802306.275481:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788802306.278226:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d0453df80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788802306.278269:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892156800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788802306.282349:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802306.282585:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872209024 00000100:00100000:3.0:1788802306.282599:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872209024 00000100:00100000:3.0:1788802306.282747:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:3.0:1788802306.282759:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2358:x1875694872209024:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788802306.377011:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1788802306.377088:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1788802306.377299:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2358:x1875694872209024:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 94530us (94956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802306.377314:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:3.0:1788802306.382149:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802306.382846:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872209280 00000100:00100000:2.0:1788802306.382863:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872209280 00000100:00100000:2.0:1788802306.382954:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:2.0:1788802306.382969:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:10474:x1875694872209280:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788802306.383053:0:9415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802306.383089:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c31f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded58 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802306.383113:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d02e21700) 00010000:00010000:2.0:1788802306.383120:0:9415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802306.383160:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802306.383176:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802306.383188:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802306.383613:0:9415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a6fd28e reply state 00000000408598f6 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802306.383954:0:9415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788802306.384137:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10474:x1875694872209280:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 1168us (2001us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788802306.384146:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 81 00010000:00010000:3.0:1788802306.388789:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.388815:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.388824:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.388831:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95fc00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802306.388838:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.388875:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.388971:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d02e21700) 00010000:00010000:3.0:1788802306.388976:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802306.388984:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.388991:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c334 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802306.391947:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802306.392089:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872209408 00000100:00100000:2.0:1788802306.392108:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872209408 00000100:00100000:2.0:1788802306.392184:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:2.0:1788802306.392197:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872209408:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788802306.392917:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788802306.392924:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788802306 -> 1788802305 00002000:00010000:2.0:1788802306.392927:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788802303 00002000:00010000:2.0:1788802306.392929:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788802306 -> 1788802305 00002000:00010000:2.0:1788802306.392932:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788802306.393095:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872209408:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 895us (1161us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788802306.393107:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:2.0:1788802306.397094:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.397213:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872209664 00000100:00100000:1.0:1788802306.397229:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872209664 00000100:00100000:1.0:1788802306.397349:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:1.0:1788802306.397362:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:10474:x1875694872209664:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788802306.397483:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.397530:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded4a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.397543:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.397598:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded4a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.397617:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded4a expref: 13 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802306.397650:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d358bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892156928:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802306.397783:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802306.404848:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d358bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892156928:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802306.404903:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802306.405570:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.405871:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872209792 00000100:00100000:1.0:1788802306.405884:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872209792 00010000:00010000:1.0:1788802306.405943:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded4a expref: 14 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802306.406027:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:1.0:1788802306.406040:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:2359:x1875694872209792:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802306.406063:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802306.406073:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded4a expref: 14 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.406089:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded4a expref: 14 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.406142:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c2fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded4a expref: 14 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.406165:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d02e21700) 00010000:00010000:1.0:1788802306.406171:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.406182:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.406191:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.406313:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802306.406388:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:2359:x1875694872209792:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 350us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802306.406396:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00010000:00010000:3.0:1788802306.407065:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.407076:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.407112:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.407119:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.407127:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.407133:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802306.407139:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.407164:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.407179:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d02e21700) 00010000:00010000:3.0:1788802306.407182:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788802306.407187:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.407193:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c33b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802306.407409:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:10474:x1875694872209664:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 Request processed in 10047us (10330us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788802306.407421:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:2.0:1788802306.412743:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.412888:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872209920 00000100:00100000:1.0:1788802306.412916:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872209920 00000100:00100000:1.0:1788802306.412996:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:1.0:1788802306.413010:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872209920:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788802306.413074:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.413100:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.413136:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802306.413142:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802306.413148:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.413197:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.413214:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 7 pid: 6690 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802306.413233:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d358bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875694892157056:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802306.413398:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802306.425604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.425749:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d358bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875694892157056:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802306.425787:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802306.425869:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872210048 00000100:00100000:3.0:1788802306.425880:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872210048 00010000:00010000:3.0:1788802306.425939:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 8 pid: 6690 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802306.425983:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:3.0:1788802306.425993:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2360:x1875694872210048:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802306.426010:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802306.426042:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 8 pid: 6690 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.426056:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 8 pid: 6690 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.426111:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f33ab379/0x6ecba1490fc9c32d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded66 expref: 8 pid: 6690 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.426131:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788802306.426137:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788802306.426143:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.426153:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.426193:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802306.426303:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872210048:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 310us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802306.426311:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00010000:00010000:0.0:1788802306.426706:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.426718:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.426749:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.426758:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.426767:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.426790:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3e00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802306.426795:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.426805:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.426821:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.426829:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cea050c/0x6ecba1490fc9c342 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802306.426915:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872209920:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 13908us (14190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802306.426924:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:0.0:1788802306.430342:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802306.430513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872210304 00000100:00100000:3.0:1788802306.430528:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872210304 00000100:00100000:3.0:1788802306.430605:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:3.0:1788802306.430617:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:10474:x1875694872210304:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788802306.430765:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c349 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.430789:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.430803:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.431126:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.431140:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c30a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded51 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.431149:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.431199:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c30a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded51 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.431217:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c30a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded51 expref: 13 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802306.431233:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892157184:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802306.431406:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d082bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788802306.439836:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.439968:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872210432 00000100:00100000:1.0:1788802306.439983:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872210432 00010000:00010000:1.0:1788802306.440045:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c30a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded51 expref: 14 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802306.440095:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:1.0:1788802306.440108:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:2360:x1875694872210432:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802306.440149:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802306.440158:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c30a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded51 expref: 14 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.440174:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c30a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded51 expref: 14 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.440204:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d02e21700) 00010000:00010000:1.0:1788802306.440210:0:7624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.440223:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.440231:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.440293:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802306.440371:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:2360:x1875694872210432:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 265us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802306.440379:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00010000:00010000:0.0:1788802306.440527:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c30a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded51 expref: 13 pid: 5843 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802306.440547:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892157184:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802306.440575:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.440584:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802306.440597:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802306.440876:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788802306.441062:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788802306.441108:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788802306.441229:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875694892157312:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788802306.441337:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802306.441377:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d01377000 going to sleep for 11 seconds 00000100:00100000:1.0:1788802306.441716:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892157312 00000100:00100000:1.0:1788802306.441725:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892157312 00000100:00100000:1.0:1788802306.441781:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788802306.441791:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875694892157312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788802306.441888:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875694892157312:12345-0@lo:1000:mdt00_002.0 Request processed in 99us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802306.441909:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788802306.443475:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788802306.443492:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d0453df80, transno 4294967303 00000100:00100000:0.0:1788802306.443521:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875694892157312:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788802306.444786:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788802306.446314:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875694892157440:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788802306.446431:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802306.448100:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d15752a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788802306.448570:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892157440 00000100:00100000:1.0:1788802306.448586:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892157440 00000100:00100000:0.0:1788802306.451668:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788802306.451706:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875694892157440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788802306.452162:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875694892157440:12345-0@lo:1000:mdt00_002.0 Request processed in 474us (5728us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788802306.452171:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788802306.452352:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875694892157440:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788802306.452422:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452436:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452460:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452468:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802306.452475:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452484:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452504:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d02e21700) 00010000:00010000:1.0:1788802306.452508:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788802306.452516:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452523:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c350 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452575:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c285 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452583:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c285 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452609:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c285 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452615:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802306.452618:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c285 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452625:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c285 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452637:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21800) 00010000:00010000:1.0:1788802306.452640:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788802306.452643:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c285 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452650:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c285 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452720:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452739:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded35 expref: 16 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452751:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452795:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded35 expref: 16 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.452830:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded35 expref: 16 pid: 9415 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802306.452849:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d358bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892157568:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802306.452974:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d15752a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788802306.458037:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802306.458081:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872210560 00000100:00100000:3.0:1788802306.458095:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872210560 00010000:00010000:3.0:1788802306.458172:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded35 expref: 17 pid: 9415 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802306.458215:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:3.0:1788802306.458227:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:2360:x1875694872210560:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802306.458272:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802306.458306:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded35 expref: 17 pid: 9415 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.458336:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded35 expref: 17 pid: 9415 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.458396:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21800) 00010000:00010000:3.0:1788802306.458404:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.458425:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.458444:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.458469:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802306.458608:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:2360:x1875694872210560:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 381us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802306.458630:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00010000:00010000:3.0:1788802306.458938:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c2a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded35 expref: 16 pid: 9415 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802306.458961:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d358bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892157568:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802306.458989:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.458999:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459019:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459036:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459043:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459051:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459057:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802306.459063:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459071:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459082:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21800) 00010000:00010000:3.0:1788802306.459086:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802306.459090:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459097:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c357 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459107:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459113:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c349 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459124:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c349 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459129:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802306.459133:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c349 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459140:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c349 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459148:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21800) 00010000:00010000:3.0:1788802306.459151:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788802306.459154:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c349 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.459159:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c349 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788802306.459609:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802306.459616:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802306.459644:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788802306.459650:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788802306.459778:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:10474:x1875694872210304:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 29158us (29448us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788802306.459790:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 83 00000020:00080000:3.0:1788802306.459796:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788802306.466785:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.466935:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872210816 00000100:00100000:1.0:1788802306.466949:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872210816 00000100:00100000:1.0:1788802306.467032:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:1.0:1788802306.467046:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:10474:x1875694872210816:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788802306.468198:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788802306.468410:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788802306.468477:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.468499:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.468514:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.468525:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.468533:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.468539:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.468582:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788802306.468751:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788802306.468759:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.468794:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802306.468800:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.468808:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.468846:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff910d05184b00) 00010000:00010000:3.0:1788802306.468851:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788802306.468873:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.468893:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c35e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.468930:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802306.468933:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802306.468935:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802306.469122:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:10474:x1875694872210816:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 2071us (2351us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788802306.469134:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000020:00080000:1.0:1788802306.469141:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1788802306.689788:0:12001:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788802306.689804:0:12001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788802306.689869:0:12001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788802306.689877:0:12001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788802306.861955:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802306.862568:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872211072 00000100:00100000:3.0:1788802306.862584:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872211072 00000100:00100000:3.0:1788802306.863272:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:3.0:1788802306.863523:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:10484:x1875694872211072:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802306.863561:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802306.863984:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded6d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.864138:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8000/0x6ecba1490fc9c36c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.864738:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8000/0x6ecba1490fc9c36c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.864768:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8000/0x6ecba1490fc9c36c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802306.864787:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788802306.866549:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded6d expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.866586:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8000/0x6ecba1490fc9c36c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded6d expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.866598:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:3.0:1788802306.866601:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788802306.866607:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8000, rc 0) 00000100:00100000:3.0:1788802306.867137:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10484:x1875694872211072:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 3618us (5192us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788802306.867158:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:0.0:1788802306.872978:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802306.873295:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872211200 00000100:00100000:3.0:1788802306.873309:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872211200 00000100:00100000:3.0:1788802306.873965:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:3.0:1788802306.873983:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10484:x1875694872211200:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:3.0:1788802306.874100:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c37a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.874124:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c37a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.874138:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c37a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.874166:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.874172:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.874177:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.877907:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.877936:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.877955:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802306.878031:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878049:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c37a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878056:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c37a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878064:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c37a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878071:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802306.878076:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c37a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878092:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c37a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878108:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:3.0:1788802306.878112:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802306.878119:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c37a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878125:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c37a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878140:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878146:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c381 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878389:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878394:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802306.878397:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878404:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878532:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d02e21800) 00010000:00010000:3.0:1788802306.878537:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802306.878541:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c381 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878560:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878583:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878589:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878595:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878600:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802306.878604:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878610:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878618:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d02e21300) 00010000:00010000:3.0:1788802306.878620:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802306.878700:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.878708:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802306.879062:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10484:x1875694872211200:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 5076us (6093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802306.879075:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:0.0:1788802306.926586:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.926748:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872211456 00000100:00100000:1.0:1788802306.926763:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872211456 00000100:00100000:1.0:1788802306.926856:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:1.0:1788802306.926871:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10487:x1875694872211456:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802306.926917:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802306.926948:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c38f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded74 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.927061:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c396 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.927082:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.927100:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.927121:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c39d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.927137:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.927145:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.928119:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.928134:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.928145:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802306.928159:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788802306.929235:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929284:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c396 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929293:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929300:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802306.929307:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929316:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c396 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929361:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802306.929365:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802306.929373:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929380:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929396:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929402:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c39d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929409:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929415:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802306.929418:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929426:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c39d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929434:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d05184100) 00010000:00010000:1.0:1788802306.929436:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802306.929440:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c39d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929446:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c39d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929543:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c38f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded74 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929560:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded74 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802306.929569:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802306.929571:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802306.929574:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3600, rc 0) 00000100:00100000:1.0:1788802306.931907:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10487:x1875694872211456:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 5015us (5312us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788802306.931922:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:3.0:1788802306.937933:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802306.938128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872211584 00000100:00100000:0.0:1788802306.938153:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872211584 00000100:00100000:3.0:1788802306.939058:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 87 00000100:00100000:3.0:1788802306.939073:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10487:x1875694872211584:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:3.0:1788802306.939207:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.939231:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.939349:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.939400:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.939539:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.939550:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.939558:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802306.939563:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.939588:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.939603:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:3.0:1788802306.939607:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788802306.939615:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802306.939622:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802306.939764:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10487:x1875694872211584:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 691us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802306.939774:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 87 00000100:00100000:0.0:1788802306.942978:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802306.943118:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872211840 00000100:00100000:1.0:1788802306.943133:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872211840 00000100:00100000:1.0:1788802306.943264:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:1.0:1788802306.943286:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10487:x1875694872211840:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788802306.943649:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:10487:x1875694872211840:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 364us (684us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788802306.943657:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:2.0:1788802307.014721:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.014854:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872212096 00000100:00100000:3.0:1788802307.014869:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872212096 00000100:00100000:3.0:1788802307.014958:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:3.0:1788802307.014971:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:10014:x1875694872212096:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788802307.015006:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802307.015035:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded7b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.015185:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.015206:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded74 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.015217:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788802307.015364:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788802307.015417:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded74 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.015437:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded74 expref: 23 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802307.015457:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892157696:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802307.016204:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d082bf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788802307.024079:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.024188:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872212224 00000100:00100000:1.0:1788802307.024202:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872212224 00010000:00010000:1.0:1788802307.024346:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded74 expref: 24 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.024597:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:0.0:1788802307.024678:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:2360:x1875694872212224:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788802307.024707:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802307.024717:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded74 expref: 24 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.024734:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded74 expref: 24 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.024763:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802307.024770:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.024783:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.024793:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.024817:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802307.025017:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:2360:x1875694872212224:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 409us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802307.025026:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00010000:00010000:3.0:1788802307.025941:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c3a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded74 expref: 23 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802307.025966:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892157696:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802307.025996:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.026007:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.026014:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802307.026044:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788802307.026294:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c3b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded7b expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.026313:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded7b expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.026324:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:3.0:1788802307.026328:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788802307.026331:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8c00, rc 0) 00000100:00100000:3.0:1788802307.026391:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:10014:x1875694872212096:12345-192.168.201.57@tcp:101:bash.0 Request processed in 11422us (11686us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788802307.026400:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:2.0:1788802307.033062:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.033379:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872212480 00000100:00100000:0.0:1788802307.033403:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872212480 00000100:00100000:0.0:1788802307.033593:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:0.0:1788802307.033794:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:10014:x1875694872212480:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:0.0:1788802307.034205:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.034227:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.034400:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802307.034471:0:9415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788802307.034499:0:9415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009be85bf7 reply state 000000004a7d23b8 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.034510:0:9415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788802307.034562:0:9415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788802307.034769:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:10014:x1875694872212480:12345-192.168.201.57@tcp:36:bash.0 Request processed in 1161us (1719us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788802307.034778:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 89 00000020:00080000:0.0:1788802307.034785:0:9415:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788802307.036693:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.036731:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.036739:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.036746:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802307.036751:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.036759:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.036777:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:3.0:1788802307.036780:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802307.036785:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.036791:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c3ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802307.038653:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.038831:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872212608 00000100:00100000:3.0:1788802307.038845:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872212608 00000100:00100000:3.0:1788802307.038966:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:3.0:1788802307.038979:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:10014:x1875694872212608:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788802307.039013:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802307.039038:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c3d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded82 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.039114:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded82 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.039143:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded82 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.039168:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:3.0:1788802307.039171:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788802307.039176:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9e00, rc 0) 00000100:00100000:3.0:1788802307.039360:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:10014:x1875694872212608:12345-192.168.201.57@tcp:101:bash.0 Request processed in 384us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802307.039368:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:2.0:1788802307.042103:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.042286:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872212736 00000100:00100000:3.0:1788802307.042298:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872212736 00000100:00100000:3.0:1788802307.042360:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:3.0:1788802307.042371:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d035b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:10014:x1875694872212736:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788802307.042399:0:8127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802307.042428:0:8127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d26a9e5b/0x6ecba1490fc9c3dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded89 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788802307.042466:0:8127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ef501, atime: 0x6a9ef4ff, ctime: 0x6a9ef501, blocks: 0xb 00010000:00010000:3.0:1788802307.042496:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1788802307.042502:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802307.042511:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d26a9e5b/0x6ecba1490fc9c3dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded89 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.042529:0:8127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d26a9e5b/0x6ecba1490fc9c3dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded89 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.042556:0:8127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9000, rc 0) 00000100:00100000:3.0:1788802307.042639:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d035b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:10014:x1875694872212736:12345-192.168.201.57@tcp:101:bash.0 Request processed in 270us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802307.042647:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:0.0:1788802307.045817:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.045920:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872212864 00000100:00100000:3.0:1788802307.045934:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872212864 00002000:00010000:3.0:1788802307.045989:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788802307.045995:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d41e6f480 with x1875694872212864 ext(0->18446744073709551615) 00002000:00010000:3.0:1788802307.046010:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d41e6f480. 00000100:00100000:3.0:1788802307.046054:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:3.0:1788802307.046066:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2357:x1875694872212864:12345-192.168.201.57@tcp:10:bash.0 00002000:00010000:3.0:1788802307.046532:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788802307.046538:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788802305 -> 1788802306 00002000:00010000:3.0:1788802307.046541:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788802303 -> 1788802303 00002000:00010000:3.0:1788802307.046544:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788802305 -> 1788802306 00002000:00010000:3.0:1788802307.046546:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788802307.046631:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2357:x1875694872212864:12345-192.168.201.57@tcp:10:bash.0 Request processed in 565us (829us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788802307.046640:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00002000:00010000:3.0:1788802307.046644:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788802307.046647:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d41e6f480 with x1875694872212864 ext(0->18446744073709551615) 00002000:00010000:3.0:1788802307.046653:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d41e6f480. 00000100:00100000:1.0:1788802307.119168:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.119751:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872212992 00000100:00100000:3.0:1788802307.119767:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872212992 00000100:00100000:2.0:1788802307.120089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 91 00000100:00100000:2.0:1788802307.120103:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:10501:x1875694872212992:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:2.0:1788802307.120217:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c3e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.120371:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.120392:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.120412:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c3ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.120421:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c3ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.120427:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c3ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121020:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121031:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121040:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802307.121102:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121116:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121131:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c3e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121140:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121148:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ec00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802307.121153:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121163:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c3e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121180:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:2.0:1788802307.121184:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802307.121191:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c3e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121198:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c3e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121215:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c3ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121221:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c3ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121227:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c3ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121232:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802307.121370:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c3ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121378:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c3ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121386:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d03b55b00) 00010000:00010000:2.0:1788802307.121389:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802307.121392:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c3ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121398:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c3ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121415:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121421:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121428:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121433:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802307.121437:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121596:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121605:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:2.0:1788802307.121679:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802307.121701:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.121708:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c3f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802307.121843:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:10501:x1875694872212992:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 1736us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802307.121856:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 91 00010000:00010000:1.0:1788802307.149419:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802307.162022:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.162152:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872213248 00000100:00100000:3.0:1788802307.162166:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872213248 00000100:00100000:3.0:1788802307.162299:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:3.0:1788802307.162312:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:10504:x1875694872213248:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802307.162340:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802307.162368:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c3f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded90 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.162490:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c3ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.162510:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c3ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.162525:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c3ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.162544:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.162552:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.162559:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.162952:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c40d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.162963:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.162984:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802307.162998:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788802307.163129:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c3ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163135:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c3ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163141:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c3ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163145:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802307.163148:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c3ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163153:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c3ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163168:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:3.0:1788802307.163171:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802307.163178:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c3ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163184:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c3ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163201:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163207:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c406 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163217:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163220:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802307.163222:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163226:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163231:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d02e21c00) 00010000:00010000:3.0:1788802307.163233:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802307.163277:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c406 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163282:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163330:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c3f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded90 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163340:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c40d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded90 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.163345:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:3.0:1788802307.163346:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788802307.163349:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8800, rc 0) 00000100:00100000:3.0:1788802307.163433:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:10504:x1875694872213248:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1124us (1429us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788802307.163457:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:0.0:1788802307.169823:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.169958:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872213376 00000100:00100000:1.0:1788802307.169972:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872213376 00000100:00100000:1.0:1788802307.170054:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:1.0:1788802307.170067:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:10504:x1875694872213376:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:1.0:1788802307.170172:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.170195:0:9415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded7b expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.170205:0:9415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.170303:0:9415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded7b expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.170320:0:9415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded7b expref: 29 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802307.170338:0:9415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d358bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9415:1875694892157824:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802307.170473:0:9415:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d01254840 going to sleep for 11 seconds 00000100:00100000:2.0:1788802307.174510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.174752:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872213632 00000100:00100000:3.0:1788802307.174766:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872213632 00000100:00100000:3.0:1788802307.174852:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:3.0:1788802307.174866:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:5598:x1875694872213632:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788802307.175437:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:5598:x1875694872213632:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 570us (940us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788802307.175511:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:1.0:1788802307.175771:0:9415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d358bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9415:1875694892157824:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802307.175807:0:9415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802307.178750:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.178952:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872213760 00000100:00100000:0.0:1788802307.178969:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872213760 00010000:00010000:0.0:1788802307.179033:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded7b expref: 31 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.179084:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:0.0:1788802307.179096:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:2360:x1875694872213760:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788802307.179135:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802307.179144:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded7b expref: 31 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.179160:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded7b expref: 31 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.179190:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9c3c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded7b expref: 31 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.179212:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802307.179218:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.179232:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.179483:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.179515:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802307.179600:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:2360:x1875694872213760:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 505us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802307.179672:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00010000:00010000:1.0:1788802307.180429:0:9415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.180447:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.180509:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.180518:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.180525:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.180532:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802307.180538:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.180546:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.180562:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802307.180566:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788802307.180570:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.180578:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c41b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802307.180676:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:10504:x1875694872213376:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 10610us (10871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802307.180717:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:3.0:1788802307.184521:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.184697:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872214016 00000100:00100000:1.0:1788802307.184712:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872214016 00000100:00100000:1.0:1788802307.184784:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:1.0:1788802307.184814:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:10504:x1875694872214016:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788802307.185411:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:10504:x1875694872214016:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 594us (899us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788802307.185421:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:0.0:1788802307.274938:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.275111:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872214272 00000100:00100000:3.0:1788802307.275127:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872214272 00000100:00100000:3.0:1788802307.275208:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:3.0:1788802307.275220:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:10515:x1875694872214272:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:3.0:1788802307.275293:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802307.275321:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c422 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.275428:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c429 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.275456:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c429 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.275470:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c429 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.275510:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.275517:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.275525:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.275878:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c437 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.275888:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.275896:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802307.275909:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788802307.276024:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c429 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276033:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c429 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276041:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c429 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276048:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802307.276053:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c429 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276073:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c429 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276089:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:3.0:1788802307.276093:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802307.276100:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c429 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276107:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c429 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276123:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276128:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c430 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276135:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276140:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802307.276143:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276149:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276155:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d02e21c00) 00010000:00010000:3.0:1788802307.276157:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802307.276160:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c430 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276174:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276224:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c422 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded97 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276303:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c437 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded97 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.276313:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:3.0:1788802307.276315:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788802307.276318:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9400, rc 0) 00000100:00100000:3.0:1788802307.276411:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10515:x1875694872214272:12345-192.168.201.57@tcp:101:cat.0 Request processed in 1192us (1487us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788802307.276420:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:3.0:1788802307.281705:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.281889:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872214528 00000100:00100000:0.0:1788802307.281905:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872214528 00000100:00100000:0.0:1788802307.281990:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:0.0:1788802307.282002:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10515:x1875694872214528:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:0.0:1788802307.282417:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10515:x1875694872214528:12345-192.168.201.57@tcp:35:cat.0 Request processed in 415us (739us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788802307.282426:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:0.0:1788802307.300539:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802307.300729:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872214784 00000100:00100000:2.0:1788802307.300745:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872214784 00000100:00100000:2.0:1788802307.300823:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 95 00000100:00100000:2.0:1788802307.300835:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10516:x1875694872214784:12345-192.168.201.57@tcp:36:rm.0 00010000:00010000:2.0:1788802307.300929:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788802307.300965:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9c437 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded97 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.300992:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c40d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded90 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.301005:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c3d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded82 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.301016:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d05184600) 00010000:00010000:2.0:1788802307.301032:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802307.301059:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c445 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.301101:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.301114:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.301132:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.301139:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.301144:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.301737:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c453 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.301748:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c453 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.301757:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c453 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788802307.302469:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788802307.302483:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360249244477ns, next at 361249241552ns, rc = 0 00010000:00010000:2.0:1788802307.302565:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.302577:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.302599:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303330:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303341:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303348:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303435:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788802307.303482:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c453 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303489:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c453 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303496:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c453 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303503:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95fc00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802307.303508:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c453 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303516:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c453 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303531:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d03b55600) 00010000:00010000:2.0:1788802307.303535:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788802307.303552:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c453 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303559:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c453 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303583:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303589:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c445 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303595:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c445 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303600:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802307.303603:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c445 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303734:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c445 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303744:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:2.0:1788802307.303747:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802307.303750:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c445 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.303756:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c445 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802307.303769:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005eb79862 reply state 00000000d0bd895c transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802307.303791:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788802307.304387:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:10516:x1875694872214784:12345-192.168.201.57@tcp:36:rm.0 Request processed in 3544us (3855us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788802307.304400:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 95 00010000:00010000:1.0:1788802307.304786:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802307.304797:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.304807:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ec00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802307.304812:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.304822:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.304838:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff910d03b55600) 00010000:00010000:1.0:1788802307.304841:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788802307.304846:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.304852:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c45a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.304986:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802307.304990:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802307.304992:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802307.317733:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.317758:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.317768:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.317776:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802307.317782:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.317816:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.317838:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d03b55b00) 00010000:00010000:3.0:1788802307.317841:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802307.317847:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.317855:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c44c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.352057:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.352193:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872215040 00000100:00100000:3.0:1788802307.352209:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872215040 00000100:00100000:3.0:1788802307.352346:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 96 00000100:00100000:3.0:1788802307.352359:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:10522:x1875694872215040:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788802307.352398:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802307.352428:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c461 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826eded9e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.352715:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c468 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.352736:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.352751:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.352767:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.352798:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.352804:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788802307.353806:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788802307.354168:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.354184:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.354196:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.354281:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.354290:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c468 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.354296:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c468 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.354303:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802307.354308:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c468 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.354316:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c468 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.354349:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:3.0:1788802307.354352:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802307.354360:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c468 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.354367:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c468 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802307.354383:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000022b5fd9 reply state 000000006b5e9022 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802307.354393:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788802307.354971:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c461 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded9e expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.354998:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded9e expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.355008:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21d00) 00010000:00010000:3.0:1788802307.355010:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788802307.355013:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8600, rc 0) 00000100:00100000:0.0:1788802307.356041:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:10522:x1875694872215040:12345-192.168.201.57@tcp:101:bash.0 Request processed in 3675us (3992us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788802307.356055:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 96 00010000:00010000:2.0:1788802307.358097:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.358123:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.358133:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.358141:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802307.358148:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.358157:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.358181:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d02e21c00) 00010000:00010000:2.0:1788802307.358184:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802307.358190:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.358198:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c46f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.359521:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.359595:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872215168 00000100:00100000:3.0:1788802307.359713:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872215168 00000100:00100000:3.0:1788802307.359916:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:3.0:1788802307.359931:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2357:x1875694872215168:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788802307.359956:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802307.359988:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030a988a3/0x6ecba1490fc9c484 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededa5 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788802307.360044:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788802307.360069:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788802307.360074:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802307.360083:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030a988a3/0x6ecba1490fc9c484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededa5 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.360104:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030a988a3/0x6ecba1490fc9c484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededa5 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.360117:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8a00, rc 0) 00000100:00100000:3.0:1788802307.360202:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2357:x1875694872215168:12345-192.168.201.57@tcp:101:bash.0 Request processed in 275us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802307.360210:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00080000:2.0:1788802307.361747:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802307.363078:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.363157:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872215296 00000100:00100000:0.0:1788802307.363170:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872215296 00000100:00100000:0.0:1788802307.363341:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:0.0:1788802307.363358:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:10522:x1875694872215296:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802307.363384:0:8127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802307.363413:0:8127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededac expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.363458:0:8127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030a988a3/0x6ecba1490fc9c484 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededa5 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.363468:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802307.363473:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802307.363479:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 9 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.363525:0:8127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030a988a3/0x6ecba1490fc9c484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededa5 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.363562:0:8127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030a988a3/0x6ecba1490fc9c484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededa5 expref: 9 pid: 6688 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.363581:0:8127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8127:1875694892157952:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802307.363847:0:8127:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d011cacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802307.367921:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.368061:0:8127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8127:1875694892157952:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802307.368108:0:8127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 9 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.368135:0:8127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0a00, rc 0) 00000100:00100000:0.0:1788802307.368219:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:10522:x1875694872215296:12345-192.168.201.57@tcp:101:bash.0 Request processed in 4864us (5151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802307.368230:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:2.0:1788802307.369216:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872215424 00000100:00100000:2.0:1788802307.369278:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872215424 00010000:00010000:2.0:1788802307.369325:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030a988a3/0x6ecba1490fc9c484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededa5 expref: 9 pid: 6688 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802307.369366:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:2.0:1788802307.369377:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2360:x1875694872215424:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802307.369396:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802307.369428:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030a988a3/0x6ecba1490fc9c484 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededa5 expref: 9 pid: 6688 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.369456:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030a988a3/0x6ecba1490fc9c484 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededa5 expref: 9 pid: 6688 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.369488:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030a988a3/0x6ecba1490fc9c484 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededa5 expref: 9 pid: 6688 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.369532:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802307.369536:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802307.369547:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.369566:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.369701:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802307.369735:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3faeaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1875694892158080:192.168.201.57@tcp:105: 00000100:00100000:2.0:1788802307.369925:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802307.377205:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.377414:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872215680 00000100:00100000:0.0:1788802307.377428:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872215680 00000100:00100000:0.0:1788802307.377509:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:0.0:1788802307.377521:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:10522:x1875694872215680:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:0.0:1788802307.378068:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:10522:x1875694872215680:12345-192.168.201.57@tcp:35:bash.0 Request processed in 547us (879us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788802307.378077:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:2.0:1788802307.378338:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3faeaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1875694892158080:192.168.201.57@tcp:105: 00010000:00010000:2.0:1788802307.378373:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802307.378403:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2360:x1875694872215424:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 9028us (10499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802307.378412:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000040:00080000:3.0:1788802307.469120:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802307.469135:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802307.469175:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788802307.469184:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788802307.553642:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.553829:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872215808 00000100:00100000:1.0:1788802307.553845:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872215808 00000100:00100000:1.0:1788802307.553925:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:1.0:1788802307.553959:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:10538:x1875694872215808:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802307.553994:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802307.554022:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededb3 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.554114:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.554135:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.554149:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802307.554194:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788802307.554198:0:9415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802307.554221:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.554289:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededb3 expref: 36 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.554312:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededb3 expref: 35 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.554322:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802307.554326:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788802307.554330:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2800, rc 0) 00000100:00100000:1.0:1788802307.554573:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:10538:x1875694872215808:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 616us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802307.554593:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:3.0:1788802307.560812:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.560917:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872216064 00000100:00100000:1.0:1788802307.560933:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872216064 00000100:00100000:1.0:1788802307.561018:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:1.0:1788802307.561033:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:10538:x1875694872216064:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802307.561065:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802307.561096:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c4a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededba expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.561278:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c4a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.561295:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.561310:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802307.561325:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788802307.561528:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c4a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededba expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.561556:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededba expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.561566:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21d00) 00010000:00010000:1.0:1788802307.561570:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802307.561575:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3c00, rc 0) 00000100:00100000:1.0:1788802307.561700:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:10538:x1875694872216064:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 669us (905us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788802307.561709:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:3.0:1788802307.565481:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802307.565621:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872216320 00000100:00100000:2.0:1788802307.565637:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872216320 00000100:00100000:2.0:1788802307.565730:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:2.0:1788802307.565744:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:10538:x1875694872216320:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802307.565784:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802307.565814:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c4b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededc1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.565976:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c4bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.565995:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c4bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.566012:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c4bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802307.566027:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788802307.566224:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c4b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededc1 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.566407:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c4bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededc1 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802307.566417:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21d00) 00010000:00010000:2.0:1788802307.566421:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788802307.566427:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95fc00, rc 0) 00000100:00100000:2.0:1788802307.566533:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+39:10538:x1875694872216320:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 792us (1072us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788802307.566541:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:3.0:1788802307.569521:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.569730:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872216448 00000100:00100000:1.0:1788802307.569748:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872216448 00000100:00100000:1.0:1788802307.569844:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:1.0:1788802307.569859:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+39:2357:x1875694872216448:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802307.569892:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802307.569932:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c4a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededba expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.569960:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21d00) 00010000:00010000:1.0:1788802307.569969:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802307.570056:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+38:2357:x1875694872216448:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 201us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802307.570065:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:3.0:1788802307.582565:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.582858:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872216576 00000100:00100000:0.0:1788802307.582873:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872216576 00000100:00100000:0.0:1788802307.582953:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:0.0:1788802307.582966:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2358:x1875694872216576:12345-192.168.201.57@tcp:1:lfs.0 00010000:00010000:0.0:1788802307.583059:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.583088:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.583100:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802307.583106:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788802307.583112:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.583160:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.583178:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 8 pid: 8127 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.583197:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875694892158208:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802307.583378:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d011cacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802307.586616:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.587183:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875694892158208:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802307.587228:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802307.587931:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872216704 00000100:00100000:1.0:1788802307.587949:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872216704 00002000:00100000:0.0:1788802307.588214:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff910d33df1f80 x1875694872216704/t0(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:448/0 lens 504/0 e 0 to 0 dl 1788802318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788802307.588271:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d33df1f80 with x1875694872216704 ext(0->8) 00010000:00010000:0.0:1788802307.588282:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 9 pid: 8127 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.588301:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 9 pid: 8127 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788802307.588311:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910d33df1f80 00000100:00100000:0.0:1788802307.588360:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:0.0:1788802307.588373:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2360:x1875694872216704:12345-192.168.201.57@tcp:4:lfs.0 00000100:00100000:0.0:1788802307.589867:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:2360:x1875694872216704:12345-192.168.201.57@tcp:4:lfs.0 Request processed in 1482us (3259us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788802307.589894:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00002000:00100000:0.0:1788802307.589908:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff910d33df1f80 x1875694872216704/t4294967302(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:448/0 lens 504/448 e 0 to 0 dl 1788802318 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788802307.589919:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d33df1f80 with x1875694872216704 ext(0->8) 00010000:00010000:0.0:1788802307.589931:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 11 pid: 8127 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.589957:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 11 pid: 8127 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788802307.589965:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910d33df1f80 00000100:00100000:3.0:1788802307.593023:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.593156:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872216832 00000100:00100000:0.0:1788802307.593190:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872216832 00010000:00010000:0.0:1788802307.593284:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 11 pid: 8127 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.593346:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:0.0:1788802307.593362:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:2359:x1875694872216832:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788802307.593385:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788802307.593421:0:7624:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788802307.593423:0:7624:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788802307 00002000:00010000:0.0:1788802307.593426:0:7624:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788802307 00002000:00010000:0.0:1788802307.593429:0:7624:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788802307 00010000:00010000:0.0:1788802307.593450:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 11 pid: 8127 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.593469:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 11 pid: 8127 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.593504:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9c48b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededac expref: 11 pid: 8127 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.593530:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788802307.593536:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788802307.593543:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.593556:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.593841:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802307.593940:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:2359:x1875694872216832:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 580us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802307.593949:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00010000:00010000:3.0:1788802307.594101:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.594114:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.594147:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.594157:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.594166:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.594176:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802307.594181:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.594192:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.594206:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.594214:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9c4ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802307.594351:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2358:x1875694872216576:12345-192.168.201.57@tcp:1:lfs.0 Request processed in 11387us (11804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802307.594360:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:3.0:1788802307.598589:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.598793:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872217088 00000100:00100000:0.0:1788802307.598809:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872217088 00000100:00100000:0.0:1788802307.598890:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:0.0:1788802307.598904:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+38:10538:x1875694872217088:12345-192.168.201.57@tcp:35:lfs.0 00000004:00010000:0.0:1788802307.599003:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c4bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededc1 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802307.599473:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788802307.599525:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788802307.600068:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788802307.600143:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.600168:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded9e expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.600179:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.600294:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded9e expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.600316:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded9e expref: 42 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.600346:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875694892158336:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802307.600482:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d157523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802307.605082:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.605188:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872217216 00000100:00100000:3.0:1788802307.605204:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872217216 00010000:00010000:3.0:1788802307.605315:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded9e expref: 43 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802307.605367:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:3.0:1788802307.605380:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+43:2360:x1875694872217216:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802307.605401:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802307.605411:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded9e expref: 43 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.605427:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded9e expref: 43 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.605457:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21d00) 00010000:00010000:3.0:1788802307.605463:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.605475:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.605485:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.605530:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802307.605614:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+43:2360:x1875694872217216:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 235us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802307.605622:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00010000:00010000:0.0:1788802307.605829:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded9e expref: 42 pid: 5843 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.605852:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875694892158336:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802307.605886:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.605897:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.605903:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802307.606088:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788802307.606391:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788802307.606541:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875694892158464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788802307.607033:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802307.607087:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d15752600 going to sleep for 11 seconds 00000100:00100000:2.0:1788802307.607732:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892158464 00000100:00100000:2.0:1788802307.607745:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892158464 00000100:00100000:2.0:1788802307.607828:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788802307.607840:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1875694892158464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788802307.607987:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1875694892158464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802307.607995:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788802307.608073:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802307.608213:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875694892158464:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788802307.609200:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788802307.609516:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3faeaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875694892158592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788802307.609693:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802307.609746:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802307.609865:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892158592 00000100:00100000:0.0:1788802307.609884:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892158592 00000100:00100000:0.0:1788802307.609938:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788802307.609949:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5846:x1875694892158592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788802307.610234:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5846:x1875694892158592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 286us (540us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788802307.610274:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788802307.610451:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3faeaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875694892158592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788802307.610551:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788802307.610612:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.610624:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.610644:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.610651:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802307.610657:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.610667:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.610701:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21d00) 00010000:00010000:1.0:1788802307.610705:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788802307.610714:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.610722:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9c4d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788802307.610992:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788802307.611135:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788802307.611149:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360557910377ns, next at 361557907342ns, rc = 0 00000001:00080000:1.0:1788802307.611155:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788802307.611193:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21d00) 00010000:00010000:1.0:1788802307.611196:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788802307.611204:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c4bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededc1 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802307.611395:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+45:10538:x1875694872217088:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 12493us (12823us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788802307.611420:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 00000020:00080000:1.0:1788802307.611427:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788802307.615574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802307.615722:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872217344 00000100:00100000:3.0:1788802307.615738:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872217344 00000100:00100000:3.0:1788802307.615828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:3.0:1788802307.615842:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+45:10538:x1875694872217344:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802307.615888:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802307.615925:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c4d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededc8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.616020:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededc8 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.616042:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededc8 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.616070:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:3.0:1788802307.616075:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788802307.616081:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8400, rc 0) 00000100:00100000:3.0:1788802307.616158:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+46:10538:x1875694872217344:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 319us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802307.616166:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:0.0:1788802307.619975:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.620072:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872217600 00000100:00100000:1.0:1788802307.620090:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872217600 00000100:00100000:1.0:1788802307.620172:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:1.0:1788802307.620186:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+46:10538:x1875694872217600:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788802307.620537:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+47:10538:x1875694872217600:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 352us (576us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788802307.620546:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:2.0:1788802307.722798:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.723037:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872217728 00000100:00100000:0.0:1788802307.723053:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872217728 00000100:00100000:0.0:1788802307.723135:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:0.0:1788802307.723149:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+47:10549:x1875694872217728:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:0.0:1788802307.723304:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c4df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723327:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c4df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723343:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c4df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723363:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c4e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723370:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723376:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723499:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723507:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723514:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788802307.723727:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723746:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c4df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723753:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c4df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723761:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c4df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723767:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802307.723772:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c4df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723781:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c4df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723797:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:0.0:1788802307.723800:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802307.723807:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c4df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723814:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c4df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723833:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723839:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c4e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723854:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723860:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802307.723863:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723941:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c4e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723951:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d02db8200) 00010000:00010000:0.0:1788802307.723954:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802307.723957:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c4e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723963:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c4e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723982:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723988:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723994:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.723999:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802307.724002:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.724018:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.724026:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:0.0:1788802307.724028:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802307.724032:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.724037:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c4ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802307.724158:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+47:10549:x1875694872217728:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 1011us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802307.724168:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:3.0:1788802307.762942:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.763116:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872217984 00000100:00100000:1.0:1788802307.763131:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872217984 00000100:00100000:1.0:1788802307.763219:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:1.0:1788802307.763234:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+47:10552:x1875694872217984:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802307.763309:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802307.763342:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c4f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededcf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763475:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c4fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763495:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c4fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763510:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c4fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763528:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c502 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763542:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763549:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763738:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763749:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763756:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802307.763768:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788802307.763908:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c4fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763916:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c4fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763923:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c4fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763930:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802307.763935:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c4fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763943:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c4fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763969:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802307.763972:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802307.763979:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c4fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.763986:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c4fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.764003:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.764008:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c502 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.764014:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.764019:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802307.764022:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.764028:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.764035:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d05184100) 00010000:00010000:1.0:1788802307.764037:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802307.764040:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c502 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.764046:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c502 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.764112:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c4f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededcf expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.764128:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededcf expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.764136:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802307.764138:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802307.764141:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2e00, rc 0) 00000100:00100000:1.0:1788802307.764297:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+49:10552:x1875694872217984:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1065us (1373us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788802307.764305:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:3.0:1788802307.768356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.768800:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872218112 00000100:00100000:1.0:1788802307.768817:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872218112 00000100:00100000:1.0:1788802307.768889:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 103 00000100:00100000:1.0:1788802307.768901:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+49:10552:x1875694872218112:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:1.0:1788802307.769007:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.769031:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.769046:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.769082:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.769112:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c517 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.769120:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.769127:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802307.769133:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.769141:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c517 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.769157:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802307.769160:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788802307.769165:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c517 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.769171:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c517 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802307.769323:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+49:10552:x1875694872218112:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 424us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802307.769334:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 103 00000100:00100000:2.0:1788802307.776564:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.777166:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872218368 00000100:00100000:1.0:1788802307.777184:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872218368 00000100:00100000:1.0:1788802307.777298:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:1.0:1788802307.777312:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+49:10552:x1875694872218368:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788802307.777837:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+50:10552:x1875694872218368:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 525us (1291us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788802307.777942:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:3.0:1788802307.923226:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.923614:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872218624 00000100:00100000:1.0:1788802307.923633:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872218624 00000100:00100000:1.0:1788802307.923798:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:1.0:1788802307.923814:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+50:10562:x1875694872218624:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788802307.923855:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802307.923859:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788802307.923915:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededb3 expref: 50 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.923943:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802307.923951:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802307.923973:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c51e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.924126:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.924146:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.924161:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802307.924177:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788802307.924708:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c51e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededd6 expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.924757:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededd6 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.924766:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802307.924769:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802307.924771:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3400, rc 0) 00000100:00100000:1.0:1788802307.924854:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+51:10562:x1875694872218624:12345-192.168.201.57@tcp:101:bash.0 Request processed in 1045us (1648us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788802307.924864:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:2.0:1788802307.928400:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.929300:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872218880 00000100:00100000:1.0:1788802307.929322:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872218880 00000100:00100000:1.0:1788802307.929404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 105 00000100:00100000:1.0:1788802307.929417:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+51:10562:x1875694872218880:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:1.0:1788802307.929712:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788802307.929754:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededd6 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.929784:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c509 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededcf expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.929797:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802307.929803:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802307.930198:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.930217:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802307.930424:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788802307.930601:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788802307.930629:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6ed25a7 reply state 000000003a85796a transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802307.930639:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788802307.930844:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+52:10562:x1875694872218880:12345-192.168.201.57@tcp:36:bash.0 Request processed in 1426us (2456us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788802307.930854:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 105 00000020:00080000:1.0:1788802307.930861:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788802307.938947:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802307.939173:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872219008 00000100:00100000:0.0:1788802307.939190:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872219008 00000100:00100000:0.0:1788802307.939304:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 106 00000100:00100000:0.0:1788802307.939319:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+52:10562:x1875694872219008:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802307.939356:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802307.939389:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c53a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededdd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.939512:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.939529:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.939537:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.939578:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.939591:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.939903:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.939912:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.939921:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.939928:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802307.939932:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.939941:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.939960:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:3.0:1788802307.939963:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802307.939966:0:3298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.939975:0:3298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.939984:0:3298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.940020:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802307.940028:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c533 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.940168:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.940177:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802307.940222:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788802307.940227:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802307.940291:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.940330:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c53a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededdd expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.940345:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededdd expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802307.940352:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:0.0:1788802307.940355:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802307.940357:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0200, rc 0) 00000100:00100000:0.0:1788802307.940442:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+52:10562:x1875694872219008:12345-192.168.201.57@tcp:101:bash.0 Request processed in 1127us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802307.940451:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 106 00000100:00100000:2.0:1788802307.943543:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802307.943714:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872219264 00000100:00100000:1.0:1788802307.943742:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872219264 00000100:00100000:1.0:1788802307.943814:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:1.0:1788802307.943827:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+52:10562:x1875694872219264:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:1.0:1788802307.944192:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+53:10562:x1875694872219264:12345-192.168.201.57@tcp:35:bash.0 Request processed in 367us (662us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788802307.944201:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:3.0:1788802307.981059:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875694892158976:0@lo:400:kworker.0 00000100:00100000:3.0:1788802307.981173:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802307.981311:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802307.981319:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892158848:0@lo:400:kworker.0 00000100:00100000:3.0:1788802307.981346:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802307.981393:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892158976 00000100:00100000:3.0:1788802307.981404:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892158976 00000100:00080000:3.0:1788802307.981444:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802307.981494:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892158848 00000100:00100000:3.0:1788802307.981498:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892158848 00000100:00100000:3.0:1788802307.981523:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788802307.981534:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875694892158976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802307.981783:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892158720:0@lo:400:kworker.0 00000100:00100000:1.0:1788802307.981831:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802307.981872:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892159232:0@lo:400:kworker.0 00000100:00100000:1.0:1788802307.981905:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802307.981927:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788802307.981934:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892159104:0@lo:400:kworker.0 00000100:00100000:1.0:1788802307.981960:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802307.982009:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892158720 00000100:00100000:1.0:1788802307.982015:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892158720 00000100:00100000:1.0:1788802307.982056:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788802307.982064:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892158720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802307.982106:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892158720:12345-0@lo:400:kworker.0 Request processed in 42us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802307.982114:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788802307.982180:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892158720:0@lo:400:kworker.0 00000100:00100000:1.0:1788802307.982210:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892159104 00000100:00100000:1.0:1788802307.982214:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892159104 00000100:00080000:1.0:1788802307.982261:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802307.982286:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788802307.982293:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892158848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802307.982328:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892158848:12345-0@lo:400:kworker.0 Request processed in 36us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802307.982335:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788802307.982349:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788802307.982355:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892159104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802307.982388:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892159104:12345-0@lo:400:kworker.0 Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802307.982394:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788802307.982421:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892159104:0@lo:400:kworker.0 00000100:00100000:1.0:1788802307.982491:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892158848:0@lo:400:kworker.0 00000100:00100000:3.0:1788802307.983028:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875694892158976:12345-0@lo:400:kworker.0 Request processed in 1492us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802307.983038:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788802307.983740:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892159232 00000100:00100000:2.0:1788802307.983752:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892159232 00000100:00100000:2.0:1788802307.983817:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788802307.983827:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875694892159232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802307.983931:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875694892159232:12345-0@lo:400:kworker.0 Request processed in 105us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802307.983938:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788802307.984177:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892159232:0@lo:400:kworker.0 00000100:00100000:1.0:1788802307.986175:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875694892158976:0@lo:400:kworker.0 00000100:00100000:2.0:1788802308.028378:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.028971:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872219392 00000100:00100000:1.0:1788802308.029007:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872219392 00000100:00100000:1.0:1788802308.029096:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 107 00000100:00100000:1.0:1788802308.029109:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+53:10568:x1875694872219392:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802308.029142:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802308.029170:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edede4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.029307:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c54f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.029326:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c54f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.029340:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c54f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802308.029387:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788802308.029392:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802308.029415:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c54f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.029509:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edede4 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.029534:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c54f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edede4 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.029544:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802308.029547:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788802308.029552:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3400, rc 0) 00000100:00100000:1.0:1788802308.029800:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:10568:x1875694872219392:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 693us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.029808:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 107 00000100:00100000:3.0:1788802308.035413:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.036456:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872219520 00000100:00100000:1.0:1788802308.036475:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872219520 00000100:00100000:1.0:1788802308.036560:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 108 00000100:00100000:1.0:1788802308.036586:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:10568:x1875694872219520:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802308.036623:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802308.036653:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c556 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededeb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.036749:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c55d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.036767:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c55d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.036783:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c55d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.036799:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.036806:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.036812:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.036937:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c56b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.036965:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.036973:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802308.037024:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788802308.037030:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802308.037053:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037067:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037077:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c55d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037083:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c55d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037091:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c55d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037098:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802308.037103:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c55d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037112:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c55d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037126:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802308.037130:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802308.037144:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c55d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037151:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c55d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037170:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037176:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c564 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037181:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037187:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802308.037190:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037196:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037204:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d05184100) 00010000:00010000:1.0:1788802308.037206:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802308.037209:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c564 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037215:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c564 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037302:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c556 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededeb expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037333:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c56b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededeb expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.037342:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802308.037344:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802308.037347:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2600, rc 0) 00000100:00100000:1.0:1788802308.037445:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:10568:x1875694872219520:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 862us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.037453:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 108 00000100:00100000:3.0:1788802308.042292:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802308.042426:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872219648 00000100:00100000:2.0:1788802308.042448:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872219648 00000100:00100000:2.0:1788802308.042528:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:2.0:1788802308.042540:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:2359:x1875694872219648:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802308.042560:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802308.042612:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9c56b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededeb expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.042640:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:2.0:1788802308.042648:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802308.042742:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:2359:x1875694872219648:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 203us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802308.042750:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788802308.044081:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.047213:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872219904 00000100:00100000:1.0:1788802308.047264:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872219904 00000100:00100000:1.0:1788802308.047360:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 109 00000100:00100000:1.0:1788802308.047373:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:10568:x1875694872219904:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802308.047407:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802308.047945:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c572 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededf2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.048104:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.048130:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededdd expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.048140:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.048192:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededdd expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.048230:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededdd expref: 55 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802308.048292:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0121a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892159360:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802308.048433:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08affcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802308.057720:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0121a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892159360:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802308.057772:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802308.064973:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802308.065512:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872220032 00000100:00100000:3.0:1788802308.065529:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872220032 00010000:00010000:3.0:1788802308.065603:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededdd expref: 56 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802308.065656:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:3.0:1788802308.065681:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:2359:x1875694872220032:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802308.065720:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802308.065730:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededdd expref: 56 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.065749:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededdd expref: 56 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.065787:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c541 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededdd expref: 56 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.065812:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:3.0:1788802308.065820:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.065834:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.065844:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.065894:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802308.065976:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:2359:x1875694872220032:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 310us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802308.065983:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00010000:00010000:2.0:1788802308.066797:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.066813:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802308.066873:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788802308.067118:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c572 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf2 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.067142:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf2 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.067151:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:2.0:1788802308.067154:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788802308.067157:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3e00, rc 0) 00000100:00100000:2.0:1788802308.067285:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:10568:x1875694872219904:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 19868us (23172us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788802308.067296:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 109 00000100:00100000:2.0:1788802308.072747:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802308.072850:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872220288 00000100:00100000:0.0:1788802308.072873:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872220288 00000100:00100000:0.0:1788802308.072963:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:0.0:1788802308.072977:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:10568:x1875694872220288:12345-192.168.201.57@tcp:103:lfs.0 00010000:00010000:0.0:1788802308.073000:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802308.073035:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c4d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededc8 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.073060:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:0.0:1788802308.073066:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802308.073389:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:10568:x1875694872220288:12345-192.168.201.57@tcp:103:lfs.0 Request processed in 414us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802308.073398:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:3.0:1788802308.080028:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.080438:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872220416 00000100:00100000:1.0:1788802308.080454:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872220416 00000100:00100000:1.0:1788802308.080529:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 110 00000100:00100000:1.0:1788802308.080540:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:10568:x1875694872220416:12345-192.168.201.57@tcp:58:lfs.0 00010000:00010000:1.0:1788802308.080948:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.080975:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.080990:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788802308.081760:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788802308.082013:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:10568:x1875694872220416:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 1469us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.082027:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 110 00000100:00100000:0.0:1788802308.085914:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802308.086097:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872220544 00000100:00100000:2.0:1788802308.086114:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872220544 00000100:00100000:2.0:1788802308.086199:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 111 00000100:00100000:2.0:1788802308.086212:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:10568:x1875694872220544:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802308.086275:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802308.086305:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c58e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826ededf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.086395:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.086410:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c58e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf9 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.086458:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.086476:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c58e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf9 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.086495:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:2.0:1788802308.086499:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788802308.086504:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c58e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf9 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.086513:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f200, rc 0) 00000100:00100000:2.0:1788802308.086737:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:10568:x1875694872220544:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 526us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802308.086745:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 111 00010000:00010000:3.0:1788802308.172523:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788802308.492695:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361439452023ns, next at 362439448649ns, rc = 0 00000100:00100000:1.0:1788802308.492799:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892159488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802308.492930:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802308.493093:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892159488 00000100:00100000:0.0:1788802308.493105:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892159488 00000100:00100000:0.0:1788802308.493196:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788802308.493209:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892159488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788802308.493288:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802308.493357:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892159488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802308.493364:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788802308.493534:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788802308.493587:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892159488:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788802308.495940:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788802308.495955:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788802308.496022:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788802308.496034:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788802308.496229:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892159616:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788802308.496401:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0739e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802308.503512:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.503694:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872220672 00000100:00100000:1.0:1788802308.503707:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872220672 00000100:00100000:1.0:1788802308.503784:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 112 00000100:00100000:1.0:1788802308.503797:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:10569:x1875694872220672:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788802308.503843:0:9415:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788802308.503996:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:10569:x1875694872220672:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 201us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.504004:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 112 00000100:00100000:3.0:1788802308.506989:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892159616:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788802308.513701:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.514045:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872220800 00000100:00100000:1.0:1788802308.514059:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872220800 00000100:00100000:1.0:1788802308.514145:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:1.0:1788802308.514158:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:10569:x1875694872220800:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788802308.514319:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c595 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.514341:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c595 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.514358:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c595 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515175:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c59c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515202:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c59c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515233:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c59c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515317:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515328:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515334:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802308.515389:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788802308.515394:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802308.515408:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515421:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c595 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515428:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c595 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515436:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c595 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515443:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802308.515448:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c595 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515456:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c595 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515481:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:1.0:1788802308.515484:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802308.515489:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c595 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515496:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c595 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515513:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c59c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515519:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c59c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515524:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c59c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515530:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802308.515532:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c59c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515538:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c59c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515546:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff910d05184100) 00010000:00010000:1.0:1788802308.515548:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802308.515551:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c59c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515556:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c59c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515775:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515784:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515790:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515796:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802308.515799:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515805:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515814:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802308.515816:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802308.515819:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.515825:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802308.515936:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:10569:x1875694872220800:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 1774us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.515946:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:2.0:1788802308.529282:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.529383:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872221056 00000100:00100000:1.0:1788802308.529394:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872221056 00000100:00100000:1.0:1788802308.529459:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:1.0:1788802308.529484:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:10569:x1875694872221056:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788802308.529507:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802308.529525:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee00 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529626:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c5b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529642:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529654:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802308.529679:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788802308.529788:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529796:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c5b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529804:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529810:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802308.529815:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529822:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529834:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802308.529844:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788802308.529851:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c5b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529857:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c5b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529901:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee00 expref: 57 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529912:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:1.0:1788802308.529915:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788802308.529919:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c5aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee00 expref: 57 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.529928:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2e00, rc 0) 00000100:00100000:1.0:1788802308.530003:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:10569:x1875694872221056:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 523us (765us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788802308.530010:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:0.0:1788802308.533739:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802308.533935:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872221184 00000100:00100000:3.0:1788802308.533973:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872221184 00000100:00100000:3.0:1788802308.534080:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:3.0:1788802308.534093:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:10569:x1875694872221184:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788802308.534144:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788802308.534292:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:10569:x1875694872221184:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 200us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802308.534300:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:2.0:1788802308.541765:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.541923:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872221440 00000100:00100000:1.0:1788802308.541935:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872221440 00000100:00100000:1.0:1788802308.542003:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 116 00000100:00100000:1.0:1788802308.542015:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:10569:x1875694872221440:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788802308.542043:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802308.542046:0:9415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788802308.542082:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c54f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edede4 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.542103:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802308.542122:0:9415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802308.542136:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee07 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788802308.542615:0:9415:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788802308.542852:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c5c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.542867:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.542879:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.542932:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee07 expref: 58 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.542948:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee07 expref: 57 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.542956:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184100) 00010000:00010000:1.0:1788802308.542959:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802308.542962:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3200, rc 0) 00000100:00100000:1.0:1788802308.543023:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+57:10569:x1875694872221440:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1010us (1271us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788802308.543032:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 116 00000100:00100000:0.0:1788802308.555137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.555276:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872221696 00000100:00100000:1.0:1788802308.555287:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872221696 00000100:00100000:1.0:1788802308.555350:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:1.0:1788802308.555362:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+57:10569:x1875694872221696:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788802308.555441:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802308.555472:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c5c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee07 expref: 57 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.555494:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184100) 00010000:00010000:1.0:1788802308.555506:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802308.555527:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.555541:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.555551:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.555564:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xdbe401bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.555588:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdbe401bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.555595:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdbe401bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.555668:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.555676:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.555682:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.555697:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802308.555702:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.556100:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.556111:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802308.556114:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802308.556119:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.556124:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.556136:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdbe401bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.556140:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdbe401bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.556146:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdbe401bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.556151:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802308.556153:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdbe401bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.556158:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdbe401bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.556178:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xdbe401bc (ffff910d05184f00) 00010000:00010000:1.0:1788802308.556180:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802308.556183:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdbe401bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.556189:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdbe401bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802308.563338:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:10569:x1875694872221696:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 7962us (8194us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788802308.563352:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:2.0:1788802308.580493:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.580909:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872221824 00000100:00100000:1.0:1788802308.580920:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872221824 00000100:00100000:1.0:1788802308.580996:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:1.0:1788802308.581007:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:10569:x1875694872221824:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788802308.581031:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802308.581055:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee0e expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.581097:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.581113:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.581126:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.581282:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee0e expref: 58 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.581305:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee0e expref: 57 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.581323:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184f00) 00010000:00010000:1.0:1788802308.581326:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788802308.581330:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2000, rc 0) 00000100:00100000:1.0:1788802308.581390:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+57:10569:x1875694872221824:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 385us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.581398:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:0.0:1788802308.587951:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802308.591062:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872222080 00000100:00100000:2.0:1788802308.591078:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872222080 00000100:00100000:2.0:1788802308.591146:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:2.0:1788802308.591169:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+57:10569:x1875694872222080:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788802308.591303:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.591324:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.591336:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788802308.591586:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1788802308.591709:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000923f55 reply state 0000000048b0b9c1 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802308.591720:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788802308.591845:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:10569:x1875694872222080:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 675us (3904us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788802308.591853:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 119 00000100:00100000:2.0:1788802308.597957:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.598462:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872222208 00000100:00100000:1.0:1788802308.598478:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872222208 00000100:00100000:1.0:1788802308.598552:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:1.0:1788802308.598564:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:10569:x1875694872222208:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788802308.598604:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802308.598627:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee15 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.598707:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee15 expref: 60 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.598724:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee15 expref: 60 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.598747:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184f00) 00010000:00010000:1.0:1788802308.598751:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788802308.598754:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3400, rc 0) 00000100:00100000:1.0:1788802308.598818:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:10569:x1875694872222208:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 257us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.598841:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 120 00010000:00010000:3.0:1788802308.604786:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.604805:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.604813:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.604820:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802308.604825:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.604834:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.604853:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184f00) 00010000:00010000:3.0:1788802308.605547:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788802308.605558:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.605566:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c5f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802308.605816:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.605985:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872222336 00000100:00100000:1.0:1788802308.605996:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872222336 00000100:00100000:1.0:1788802308.606070:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:1.0:1788802308.606080:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872222336:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788802308.606434:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2359:x1875694872222336:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 355us (622us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788802308.606442:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00080000:3.0:1788802308.607510:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788802308.618893:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.619051:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872222592 00000100:00100000:1.0:1788802308.619062:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872222592 00000100:00100000:1.0:1788802308.619127:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:1.0:1788802308.619139:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:10569:x1875694872222592:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788802308.619414:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:10569:x1875694872222592:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 276us (531us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788802308.619423:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:2.0:1788802308.627570:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802308.627681:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872222848 00000100:00100000:3.0:1788802308.627691:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872222848 00000100:00100000:3.0:1788802308.627750:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 121 00000100:00100000:3.0:1788802308.627762:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:10569:x1875694872222848:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788802308.627892:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:10569:x1875694872222848:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 133us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802308.627900:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 121 00000100:00100000:0.0:1788802308.632741:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.632846:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872222976 00000100:00100000:1.0:1788802308.632856:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872222976 00000100:00100000:1.0:1788802308.632929:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:1.0:1788802308.632940:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:10569:x1875694872222976:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788802308.632964:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802308.632988:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c5fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee1c expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.633063:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.633098:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.633110:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802308.633151:0:9415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802308.633169:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.633195:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c5fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee1c expref: 62 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.633215:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee1c expref: 61 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.633224:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184f00) 00010000:00010000:1.0:1788802308.633227:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788802308.633230:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2e00, rc 0) 00000100:00100000:1.0:1788802308.633361:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:10569:x1875694872222976:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 422us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.633368:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:0.0:1788802308.644599:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802308.645206:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872223104 00000100:00100000:2.0:1788802308.645220:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872223104 00000100:00100000:2.0:1788802308.645330:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:2.0:1788802308.645341:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2360:x1875694872223104:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802308.645362:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802308.645388:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9c60c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee23 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788802308.645440:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ef504, blocks: 0x1 00010000:00010000:2.0:1788802308.645464:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1788802308.645468:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802308.645479:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9c60c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee23 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.645500:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9c60c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee23 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.645515:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95fc00, rc 0) 00000100:00100000:2.0:1788802308.645583:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:2360:x1875694872223104:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 243us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802308.645590:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:3.0:1788802308.651611:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802308.653011:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872223360 00000100:00100000:2.0:1788802308.653029:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872223360 00000100:00100000:2.0:1788802308.653118:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:2.0:1788802308.653129:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:10569:x1875694872223360:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788802308.653282:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:10569:x1875694872223360:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 154us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802308.653290:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 123 00000100:00100000:1.0:1788802308.662673:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802308.662779:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872223488 00000100:00100000:0.0:1788802308.662790:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872223488 00000100:00100000:0.0:1788802308.662867:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:0.0:1788802308.662879:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:10569:x1875694872223488:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802308.662899:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802308.662920:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee2a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.662956:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9c60c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee23 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.662965:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802308.662970:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802308.662975:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.663010:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9c60c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee23 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.663048:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9c60c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee23 expref: 11 pid: 6687 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802308.663064:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875694892159744:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802308.663169:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0739e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802308.671819:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802308.672126:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872223616 00000100:00100000:0.0:1788802308.672141:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872223616 00010000:00010000:0.0:1788802308.672194:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9c60c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee23 expref: 12 pid: 6687 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802308.672264:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:0.0:1788802308.672275:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:2359:x1875694872223616:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788802308.672293:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802308.672323:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9c60c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee23 expref: 12 pid: 6687 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.672352:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9c60c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee23 expref: 12 pid: 6687 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.672384:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802308.672389:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802308.672398:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.672429:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.672475:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802308.672491:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1875694892159872:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788802308.672572:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0739e3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788802308.675063:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9c60c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee23 expref: 12 pid: 6687 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802308.675095:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1875694892159744:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802308.675155:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.675172:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0a00, rc 0) 00000100:00100000:1.0:1788802308.675276:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:10569:x1875694872223488:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 12398us (12622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.675285:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788802308.684817:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802308.685795:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1875694892159872:192.168.201.57@tcp:105: 00010000:00010000:0.0:1788802308.685820:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802308.685901:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:2359:x1875694872223616:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 13626us (14092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802308.685912:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:1.0:1788802308.686132:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872223744 00000100:00100000:1.0:1788802308.686140:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872223744 00002000:00100000:1.0:1788802308.686184:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff910d21a93100 x1875694872223744/t0(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:449/0 lens 504/0 e 0 to 0 dl 1788802319 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788802308.686194:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d21a93100 with x1875694872223744 ext(0->12) 00002000:00010000:1.0:1788802308.686199:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d21a93100 00000100:00100000:1.0:1788802308.686328:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:1.0:1788802308.686350:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:2360:x1875694872223744:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788802308.686849:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:2360:x1875694872223744:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 Request processed in 510us (2041us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788802308.690072:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00002000:00100000:1.0:1788802308.690092:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff910d21a93100 x1875694872223744/t4294967308(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:449/0 lens 504/448 e 0 to 0 dl 1788802319 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788802308.690103:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d21a93100 with x1875694872223744 ext(0->12) 00002000:00010000:1.0:1788802308.690111:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d21a93100 00000100:00100000:3.0:1788802308.693066:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802308.693881:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872223872 00000100:00100000:2.0:1788802308.693895:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872223872 00000100:00100000:2.0:1788802308.693966:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:2.0:1788802308.693977:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:10569:x1875694872223872:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788802308.804633:0:11960:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967385 is committed 00000020:00080000:1.0:1788802308.804679:0:11960:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910d10e840c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788802308.804696:0:11960:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d083e6200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910d10e84240 00000020:00080000:1.0:1788802308.804814:0:11960:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d083e6900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910d03932000 00000020:00080000:1.0:1788802308.804844:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:1.0:1788802308.805205:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:1.0:1788802308.805226:0:11961:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788802308.805279:0:11961:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788802308.806077:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788802308.806097:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910d082bff00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788802308.806102:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d051abd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910d082bf240 00000020:00080000:1.0:1788802308.806106:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d051abf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910d3f3e6000 00000004:00080000:1.0:1788802308.806117:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:1.0:1788802308.806286:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d01218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892160000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788802308.806377:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788802308.806469:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788802308.806516:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788802308.807106:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:10569:x1875694872223872:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 113123us (114041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802308.807118:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 124 00000100:00100000:2.0:1788802308.807268:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892160000 00000100:00100000:2.0:1788802308.807276:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892160000 00000100:00100000:2.0:1788802308.807315:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788802308.807324:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875694892160000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788802308.807348:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1788802308.807376:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.807398:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d26a9e5b/0x6ecba1490fc9c3dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded89 expref: 11 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.807407:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788802308.807412:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788802308.807416:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.807445:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d26a9e5b/0x6ecba1490fc9c3dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded89 expref: 11 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.807460:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d26a9e5b/0x6ecba1490fc9c3dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded89 expref: 11 pid: 8127 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802308.807474:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a658700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875694892160256:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802308.807532:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802308.807580:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788802308.808510:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892160128:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788802308.808560:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802308.809051:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892160128 00000100:00100000:3.0:1788802308.809060:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892160128 00000100:00100000:3.0:1788802308.809110:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788802308.809119:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1875694892160128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788802308.809141:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788802308.809172:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ef503, atime: 0x6a9ef503, ctime: 0x6a9ef503, blocks: 0x1 00010000:00010000:3.0:1788802308.809180:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c621 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.809194:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788802308.809198:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802308.809204:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.809260:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.809272:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.809280:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.809296:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788802308.809808:0:6703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802308.809816:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.809825:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802308.809830:0:6703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.809839:0:6703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.809881:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c621 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.809889:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c621 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.809908:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802308.809910:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802308.809911:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802308.811551:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3314:x1875694892160128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2424us (2981us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788802308.811565:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1788802308.811789:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d3a65a680/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788802308.811797:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892160128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788802308.822640:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802308.822708:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802308.822848:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872224128 00000100:00100000:1.0:1788802308.822858:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872224128 00010000:00010000:1.0:1788802308.822906:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d26a9e5b/0x6ecba1490fc9c3dc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded89 expref: 12 pid: 8127 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802308.822968:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:1.0:1788802308.822980:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:2359:x1875694872224128:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802308.823000:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802308.823007:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d26a9e5b/0x6ecba1490fc9c3dc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded89 expref: 12 pid: 8127 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.823023:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d26a9e5b/0x6ecba1490fc9c3dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded89 expref: 12 pid: 8127 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.823050:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802308.823055:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802308.823079:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.823090:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802308.823113:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802308.823170:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:2359:x1875694872224128:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 191us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.823177:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:0.0:1788802308.823357:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872224000 00000100:00100000:0.0:1788802308.823362:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872224000 00000100:00100000:0.0:1788802308.823406:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:0.0:1788802308.823415:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:2357:x1875694872224000:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788802308.824986:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d26a9e5b/0x6ecba1490fc9c3dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.57@tcp remote: 0x6d80875826eded89 expref: 12 pid: 8127 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802308.825011:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a658700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875694892160256:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802308.825035:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.825047:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.825054:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.825065:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.825072:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.825111:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788802308.826211:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875694892160000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18883us (19829us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788802308.826224:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788802308.826282:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802308.826290:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.826302:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802308.826308:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.826318:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.826348:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.826356:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9c61a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.826377:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802308.826379:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802308.826381:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788802308.831468:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d01218000/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788802308.831492:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d01218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892160000:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788802308.929016:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1788802308.929048:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1788802308.929352:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872224000:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 105925us (106712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802308.929363:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:3.0:1788802308.934363:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802308.934533:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872224384 00000100:00100000:2.0:1788802308.934545:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872224384 00000100:00100000:2.0:1788802308.934610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00100000:2.0:1788802308.934623:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:10569:x1875694872224384:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788802308.934693:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802308.934726:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9c605 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee1c expref: 15 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.934750:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184f00) 00010000:00010000:2.0:1788802308.934756:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802308.934789:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.934803:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.934815:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802308.935074:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d1bb20f reply state 00000000eca58b2a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802308.935085:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788802308.935708:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:10569:x1875694872224384:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 1084us (1366us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788802308.935718:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 125 00010000:00010000:3.0:1788802308.943077:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.943100:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.943109:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.943116:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ec00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802308.943120:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.943144:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.943165:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184f00) 00010000:00010000:3.0:1788802308.943168:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802308.943173:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802308.943180:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c628 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802308.953195:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802308.953590:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872224512 00000100:00100000:0.0:1788802308.953602:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872224512 00000100:00100000:0.0:1788802308.953681:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:0.0:1788802308.953693:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872224512:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788802308.953984:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788802308.953989:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788802307 00002000:00010000:0.0:1788802308.953991:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788802307 00002000:00010000:0.0:1788802308.953993:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788802308 -> 1788802307 00002000:00010000:0.0:1788802308.953996:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788802308.954058:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872224512:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 367us (874us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788802308.954066:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:2.0:1788802308.975390:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802308.975554:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872224768 00000100:00100000:0.0:1788802308.975568:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872224768 00000100:00100000:0.0:1788802308.975648:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 126 00000100:00100000:0.0:1788802308.975668:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:10569:x1875694872224768:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788802308.975752:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.975772:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee0e expref: 15 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.975782:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.975821:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee0e expref: 15 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.975835:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee0e expref: 15 pid: 9415 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802308.975885:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892160384:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802308.976111:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0739e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802308.988865:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802308.989120:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872224896 00000100:00100000:2.0:1788802308.989131:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872224896 00010000:00010000:2.0:1788802308.989176:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee0e expref: 16 pid: 9415 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802308.989268:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:2.0:1788802308.989281:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:2360:x1875694872224896:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802308.989300:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802308.989307:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee0e expref: 16 pid: 9415 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.989321:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee0e expref: 16 pid: 9415 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.989355:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184f00) 00010000:00010000:2.0:1788802308.989360:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.989372:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.989380:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.989403:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802308.989469:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:2360:x1875694872224896:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 191us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802308.989477:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00010000:00010000:0.0:1788802308.990795:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c5e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee0e expref: 15 pid: 9415 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802308.990825:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892160384:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802308.990854:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.990865:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.990872:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.990907:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.990915:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.990922:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.990927:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802308.990932:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.990976:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.990990:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184f00) 00010000:00010000:0.0:1788802308.990993:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788802308.990998:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802308.991004:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c62f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802308.991088:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10569:x1875694872224768:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 Request processed in 15422us (15712us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788802308.991098:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 126 00000100:00100000:3.0:1788802308.999140:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802308.999372:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872225024 00000100:00100000:2.0:1788802308.999383:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872225024 00000100:00100000:2.0:1788802308.999444:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:2.0:1788802308.999456:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872225024:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788802308.999526:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.999548:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.999557:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802308.999562:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788802308.999580:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.999619:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802308.999636:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 7 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802308.999660:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a658e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875694892160512:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802308.999759:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72180 going to sleep for 11 seconds 00000100:00100000:3.0:1788802309.016978:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802309.017269:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a658e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875694892160512:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802309.017300:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802309.018451:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872225152 00000100:00100000:1.0:1788802309.018463:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872225152 00010000:00010000:1.0:1788802309.018516:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 8 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802309.018558:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:1.0:1788802309.019045:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872225152:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802309.019064:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802309.019088:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 8 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.019102:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 8 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.019148:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e14c304/0x6ecba1490fc9c613 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee2a expref: 8 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.019165:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802309.019169:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802309.019176:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.019186:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.019225:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802309.019332:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872225152:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 764us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802309.019340:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00010000:00010000:2.0:1788802309.022609:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.022662:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.022701:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.022711:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.022721:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.022728:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ec00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802309.022733:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.022743:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.022763:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.022771:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9c636 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802309.024714:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872225024:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 25247us (25571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802309.024730:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:0.0:1788802309.049539:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802309.049812:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872225408 00000100:00100000:3.0:1788802309.049824:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872225408 00000100:00100000:3.0:1788802309.049908:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 127 00000100:00100000:3.0:1788802309.049919:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10569:x1875694872225408:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788802309.050005:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c63d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.050023:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.050037:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788802309.050234:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788802309.050333:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.050352:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee15 expref: 15 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.050361:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.050400:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee15 expref: 15 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.050420:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee15 expref: 15 pid: 9415 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802309.050435:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892160640:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802309.050543:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d02e2c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802309.053390:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892160640:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802309.053421:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802309.055743:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802309.056559:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872225536 00000100:00100000:1.0:1788802309.056824:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872225536 00010000:00010000:1.0:1788802309.056882:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee15 expref: 16 pid: 9415 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802309.057092:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:1.0:1788802309.057104:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:2360:x1875694872225536:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802309.057119:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802309.057126:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee15 expref: 16 pid: 9415 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.057154:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee15 expref: 16 pid: 9415 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.057181:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c5f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee15 expref: 16 pid: 9415 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.057199:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184f00) 00010000:00010000:1.0:1788802309.057204:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.057213:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.057220:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802309.057276:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802309.057334:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:2360:x1875694872225536:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 233us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802309.057342:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 57 00010000:00010000:2.0:1788802309.057969:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.057979:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788802309.058175:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788802309.058350:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788802309.058398:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788802309.058490:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a658e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875694892160768:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788802309.058552:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802309.059562:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892160768 00000100:00100000:2.0:1788802309.059593:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892160768 00000100:00100000:2.0:1788802309.059642:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802309.059662:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875694892160768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788802309.059757:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875694892160768:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802309.059765:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802309.059914:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802309.059940:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788802309.059946:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1788802309.059970:0:5842:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff910d01218000 x1875694892160000/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788802324 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802309.059983:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a658e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875694892160768:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788802309.060484:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788802309.060560:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a658e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875694892160896:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788802309.060602:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802309.060624:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1abb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802309.060641:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892160896 00000100:00100000:2.0:1788802309.060645:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892160896 00000100:00100000:2.0:1788802309.060691:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788802309.060699:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875694892160896:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788802309.060878:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1875694892160896:12345-0@lo:1000:mdt00_000.0 Request processed in 179us (275us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788802309.060886:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788802309.060923:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a658e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1875694892160896:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788802309.060952:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.060962:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.060971:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.060977:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802309.060990:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.060998:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061014:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d05184f00) 00010000:00010000:2.0:1788802309.061017:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788802309.061022:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061029:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c644 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061060:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061066:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061072:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061077:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802309.061080:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061086:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061094:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:2.0:1788802309.061096:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788802309.061108:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c58e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061121:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c58e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061131:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c58e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.061160:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c58e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802309.061173:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a65b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892161024:192.168.201.57@tcp:105: 00000100:00100000:2.0:1788802309.061273:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d10e84240 going to sleep for 11 seconds 00000001:00080000:0.0:1788802309.074395:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788802309.074413:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1788802309.074431:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:1.0:1788802309.074768:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802309.074964:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872225664 00000100:00100000:0.0:1788802309.074975:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872225664 00000100:00100000:0.0:1788802309.075033:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:0.0:1788802309.075044:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10568:x1875694872225664:12345-192.168.201.57@tcp:49:lfs.0 00000100:00100000:0.0:1788802309.075178:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:10568:x1875694872225664:12345-192.168.201.57@tcp:49:lfs.0 Request processed in 136us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802309.075186:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:2.0:1788802309.075428:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a65b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892161024:192.168.201.57@tcp:105: 00010000:00010000:2.0:1788802309.075460:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.075473:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c587 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.075505:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c64b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.075519:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c64b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.075532:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c64b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.075562:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c64b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.075568:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c64b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077258:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c64b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077267:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802309.077273:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c64b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077283:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c64b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077302:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:2.0:1788802309.077306:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802309.077310:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c64b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077317:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c64b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077336:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077342:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c63d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077348:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c63d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077368:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802309.077371:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c63d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077377:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c63d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077386:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:2.0:1788802309.077389:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788802309.077391:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c63d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.077397:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c63d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802309.077718:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:10569:x1875694872225408:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 27786us (28175us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788802309.077732:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 127 00000020:00080000:2.0:1788802309.077740:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788802309.078273:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802309.078280:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802309.079128:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788802309.079141:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788802309.086930:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802309.087462:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872225920 00000100:00100000:2.0:1788802309.087474:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872225920 00000100:00100000:2.0:1788802309.087543:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 128 00000100:00100000:2.0:1788802309.087554:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:10568:x1875694872225920:12345-192.168.201.57@tcp:58:lfs.0 00000040:00080000:2.0:1788802309.089202:0:9415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788802309.089368:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:10568:x1875694872225920:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 1810us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802309.089380:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 128 00000100:00100000:1.0:1788802309.091949:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802309.094775:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872226176 00000100:00100000:0.0:1788802309.094818:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872226176 00000100:00100000:0.0:1788802309.094892:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:0.0:1788802309.094906:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:10569:x1875694872226176:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788802309.095527:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788802309.095616:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788802309.095683:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802309.095703:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802309.095715:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802309.095722:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802309.095727:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802309.095730:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802309.095747:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788802309.095794:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788802309.095802:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.095809:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802309.095813:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.095821:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.095843:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff910d02db8700) 00000100:00100000:0.0:1788802309.095856:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:10569:x1875694872226176:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 951us (3925us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788802309.095864:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000020:00080000:0.0:1788802309.095869:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788802309.096017:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788802309.096024:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.096032:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c652 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.096052:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802309.096053:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802309.096055:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802309.188083:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802309.188228:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872226304 00000100:00100000:2.0:1788802309.188297:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872226304 00000100:00100000:2.0:1788802309.188357:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 129 00000100:00100000:2.0:1788802309.188368:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:10571:x1875694872226304:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802309.188397:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802309.188421:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c659 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee31 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.189053:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c660 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.189072:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c660 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.189084:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c660 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.189102:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c667 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.191411:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.191441:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.193858:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.193884:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf2 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.193894:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.194290:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf2 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.194315:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf2 expref: 21 pid: 5842 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802309.194333:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a65b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892161152:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802309.194554:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1abc00 going to sleep for 11 seconds 00010000:00010000:2.0:1788802309.201095:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802309.203622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802309.204721:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a65b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892161152:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802309.204751:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802309.206677:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872226560 00000100:00100000:3.0:1788802309.206702:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872226560 00000100:00100000:3.0:1788802309.206767:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:3.0:1788802309.206779:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:5599:x1875694872226560:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788802309.207049:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:5599:x1875694872226560:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 270us (3436us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788802309.207059:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:1.0:1788802309.212665:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802309.212843:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872226688 00000100:00100000:3.0:1788802309.212856:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872226688 00010000:00010000:3.0:1788802309.212901:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf2 expref: 23 pid: 5842 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802309.212945:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:3.0:1788802309.212957:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:2359:x1875694872226688:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802309.212973:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802309.212995:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf2 expref: 23 pid: 5842 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.213010:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf2 expref: 23 pid: 5842 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.213036:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c579 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf2 expref: 23 pid: 5842 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.213055:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:3.0:1788802309.213061:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.213071:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.213079:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802309.213112:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802309.213313:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213321:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802309.213386:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788802309.213391:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802309.213411:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213423:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213433:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c660 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213452:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c660 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213459:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c660 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213466:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802309.213471:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c660 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213478:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c660 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213488:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:2.0:1788802309.213490:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802309.213494:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c660 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213500:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c660 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213510:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213515:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c667 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213520:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213526:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802309.213537:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213543:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c667 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213551:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff910d2166ac00) 00010000:00010000:2.0:1788802309.213554:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802309.213557:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c667 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213562:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c667 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213599:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c659 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee31 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213612:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee31 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802309.213620:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:2.0:1788802309.213622:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802309.213625:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95fc00, rc 0) 00000100:00100000:3.0:1788802309.213735:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:2359:x1875694872226688:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 779us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802309.213745:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:2.0:1788802309.225206:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10571:x1875694872226304:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 36825us (37121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802309.225222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 129 00000040:00080000:3.0:1788802310.092434:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802310.092445:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802310.092486:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788802310.092493:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788802310.094018:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892161280:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788802310.094135:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d02e2ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802310.104107:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892161280:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788802310.107339:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802310.111959:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872226816 00000100:00100000:1.0:1788802310.111973:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872226816 00000100:00100000:1.0:1788802310.112047:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 130 00000100:00100000:1.0:1788802310.112066:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10582:x1875694872226816:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788802310.112108:0:9415:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788802310.112605:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10582:x1875694872226816:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 539us (5273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802310.112613:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 130 00000100:00100000:1.0:1788802310.121570:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802310.121783:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872227072 00000100:00100000:3.0:1788802310.121795:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872227072 00000100:00100000:3.0:1788802310.121862:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 131 00000100:00100000:3.0:1788802310.121873:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:10582:x1875694872227072:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788802310.121899:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802310.121933:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c675 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee38 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.122050:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c67c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.122064:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c67c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.122079:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c67c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802310.122091:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788802310.122219:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c675 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee38 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.122272:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c67c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee38 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.122281:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:3.0:1788802310.122284:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788802310.122288:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8e00, rc 0) 00000100:00100000:3.0:1788802310.122353:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:10582:x1875694872227072:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 482us (805us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788802310.122372:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 131 00000100:00100000:1.0:1788802310.137806:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802310.153578:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872227200 00000100:00100000:3.0:1788802310.153599:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872227200 00000100:00100000:3.0:1788802310.153699:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788802310.153711:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:2357:x1875694872227200:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802310.153730:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802310.153755:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c67c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee38 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.153771:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:3.0:1788802310.153775:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802310.153832:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:2357:x1875694872227200:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 123us (16044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802310.153839:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788802310.153988:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802310.154531:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872227456 00000100:00100000:3.0:1788802310.154538:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872227456 00000100:00100000:3.0:1788802310.154777:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 132 00000100:00100000:3.0:1788802310.154786:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:10582:x1875694872227456:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788802310.154875:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c68a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.154893:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.154906:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.156501:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.156513:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c68a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.156521:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c68a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.156527:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802310.156531:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c68a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.156539:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c68a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.156566:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:3.0:1788802310.156569:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788802310.156575:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c68a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.156581:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c68a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788802310.157124:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788802310.157128:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788802310.157622:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788802310.157641:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788802310.158047:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:10582:x1875694872227456:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 3255us (4053us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788802310.158058:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 132 00000100:00100000:1.0:1788802310.168410:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802310.168445:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872227712 00000100:00100000:1.0:1788802310.168455:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872227712 00000100:00100000:1.0:1788802310.168506:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:1.0:1788802310.168516:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:10582:x1875694872227712:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788802310.168762:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:10582:x1875694872227712:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 247us (362us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788802310.168769:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00010000:00010000:3.0:1788802310.220602:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788802310.256065:0:12052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788802310.256078:0:12052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788802310.256141:0:12052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788802310.256150:0:12052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788802310.449328:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802310.449609:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872227968 00000100:00100000:1.0:1788802310.449619:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872227968 00000100:00100000:1.0:1788802310.449693:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 133 00000100:00100000:1.0:1788802310.449703:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:10595:x1875694872227968:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802310.449732:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802310.449754:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c691 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802310.449860:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c698 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802310.449891:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c698 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802310.449904:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c698 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802310.449916:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788802310.450053:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c691 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee3f expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802310.450074:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c698 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee3f expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802310.450084:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802310.450087:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788802310.450092:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3c00, rc 0) 00000100:00100000:1.0:1788802310.450160:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:10595:x1875694872227968:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 458us (842us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788802310.450167:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 133 00000100:00100000:0.0:1788802310.460823:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802310.460913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872228096 00000100:00100000:3.0:1788802310.460925:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872228096 00000100:00100000:3.0:1788802310.461008:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00100000:3.0:1788802310.461019:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:10595:x1875694872228096:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:3.0:1788802310.461093:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c6a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.461112:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.461124:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.461154:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.461161:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.461168:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.461174:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802310.461178:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.461185:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.461197:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:3.0:1788802310.461202:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788802310.461218:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c6a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.461258:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9800/0x6ecba1490fc9c6a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802310.461342:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:10595:x1875694872228096:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 324us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802310.461350:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00100000:0.0:1788802310.544421:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788802310.544445:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d358bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892161408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802310.544514:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802310.544592:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892161408 00000100:00100000:0.0:1788802310.544599:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892161408 00000100:00100000:0.0:1788802310.544667:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788802310.544677:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d063d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892161408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802310.544715:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802310.544761:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d063d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892161408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802310.544768:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788802310.544800:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802310.544831:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788802310.544837:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1788802310.544854:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d082f6d80, transno 4294967301 00000004:00080000:0.0:1788802310.544864:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788802310.544874:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d3a65a680, transno 4294967304 00000100:00100000:0.0:1788802310.544885:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d358bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892161408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802310.574171:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802310.574460:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872228224 00000100:00100000:3.0:1788802310.574472:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872228224 00000100:00100000:3.0:1788802310.574545:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:3.0:1788802310.574557:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872228224:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:3.0:1788802310.574587:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802310.574612:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021fc9771/0x6ecba1490fc9c6ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee46 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788802310.574652:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ef503, atime: 0x6a9ef503, ctime: 0x6a9ef503, blocks: 0xb 00010000:00010000:3.0:1788802310.574674:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1788802310.574678:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802310.574688:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021fc9771/0x6ecba1490fc9c6ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee46 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.574709:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021fc9771/0x6ecba1490fc9c6ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee46 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802310.574723:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9800, rc 0) 00000100:00100000:3.0:1788802310.574802:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872228224:12345-192.168.201.57@tcp:101:cat.0 Request processed in 247us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802310.574833:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00080000:0.0:1788802310.574908:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788802310.579933:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802310.580055:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872228352 00000100:00100000:2.0:1788802310.580066:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872228352 00002000:00100000:2.0:1788802310.580124:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff910d3faeaa00 x1875694872228352/t0(0) o3->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:451/0 lens 488/0 e 0 to 0 dl 1788802321 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788802310.580134:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d3faeaa00 with x1875694872228352 ext(0->4095) 00002000:00010000:2.0:1788802310.580141:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d3faeaa00 00000100:00100000:2.0:1788802310.580176:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:2.0:1788802310.580187:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872228352:12345-192.168.201.57@tcp:3:cat.0 00000100:00100000:2.0:1788802310.580483:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872228352:12345-192.168.201.57@tcp:3:cat.0 Request processed in 297us (564us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788802310.580491:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00002000:00100000:2.0:1788802310.580498:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff910d3faeaa00 x1875694872228352/t0(0) o3->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:451/0 lens 488/4536 e 0 to 0 dl 1788802321 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788802310.580507:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d3faeaa00 with x1875694872228352 ext(0->4095) 00002000:00010000:2.0:1788802310.580511:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d3faeaa00 00000100:00100000:1.0:1788802310.641166:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802310.641215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802310.641315:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802310.641334:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872228736 00000100:00100000:1.0:1788802310.641340:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802310.641348:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872228736 00000100:00080000:1.0:1788802310.641384:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802310.641432:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:3.0:1788802310.641438:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872228480 00000100:00100000:3.0:1788802310.641443:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872228480 00000100:00100000:0.0:1788802310.641443:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872228736:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802310.641471:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 292 00000100:00100000:3.0:1788802310.641477:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872228480:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802310.641614:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872228608 00000100:00100000:2.0:1788802310.641628:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872228608 00000100:00100000:2.0:1788802310.641667:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872228864 00000100:00100000:2.0:1788802310.641671:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872228864 00000100:00100000:2.0:1788802310.641700:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 143 00000100:00100000:2.0:1788802310.641707:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:2360:x1875694872228608:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802310.641781:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872228736:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 339us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802310.641790:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:1.0:1788802310.641936:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 144 00000100:00100000:1.0:1788802310.641945:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872228864:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802310.642898:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08def850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872228480:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 1412us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802310.642910:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 292 00000100:00080000:3.0:1788802310.642978:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802310.646747:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:2360:x1875694872228608:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 5024us (5416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802310.646764:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 143 00000100:00100000:2.0:1788802310.652699:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872228864:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 10742us (11343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802310.652714:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 144 00010000:00010000:3.0:1788802311.244689:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802312.271141:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802313.101029:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892161792:0@lo:400:kworker.0 00000100:00100000:1.0:1788802313.101029:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892161536:0@lo:400:kworker.0 00000100:00100000:0.0:1788802313.101125:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892161664:0@lo:400:kworker.0 00000100:00100000:1.0:1788802313.105038:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802313.105117:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892162048:0@lo:400:kworker.0 00000100:00100000:1.0:1788802313.105165:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802313.105307:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892161536 00000100:00100000:3.0:1788802313.105316:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892161536 00000100:00100000:3.0:1788802313.105371:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788802313.105381:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892161536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802313.105433:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892161536:12345-0@lo:400:kworker.0 Request processed in 53us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802313.105440:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788802313.105472:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892162048 00000100:00100000:3.0:1788802313.105476:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892162048 00000100:00100000:3.0:1788802313.105511:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788802313.105529:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892162048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802313.105563:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892162048:12345-0@lo:400:kworker.0 Request processed in 46us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802313.105597:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788802313.105616:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802313.105651:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892161920:0@lo:400:kworker.0 00000100:00100000:3.0:1788802313.105704:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802313.106180:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892161920 00000100:00100000:1.0:1788802313.106186:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892161920 00000100:00100000:1.0:1788802313.106260:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788802313.106268:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892161920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802313.106310:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892161920:12345-0@lo:400:kworker.0 Request processed in 44us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802313.106316:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788802313.106370:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892161536:0@lo:400:kworker.0 00000100:00100000:1.0:1788802313.106385:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892162048:0@lo:400:kworker.0 00000100:00080000:3.0:1788802313.107509:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802313.107571:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892161920:0@lo:400:kworker.0 00000100:00100000:0.0:1788802313.109125:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802313.109186:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892162176:0@lo:400:kworker.0 00000100:00100000:0.0:1788802313.109220:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802313.109603:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892162176 00000100:00100000:1.0:1788802313.109614:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892162176 00000100:00100000:1.0:1788802313.109693:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788802313.109703:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875694892162176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802313.109764:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875694892162176:12345-0@lo:400:kworker.0 Request processed in 63us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802313.109781:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788802313.110116:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892161664 00000100:00100000:3.0:1788802313.110122:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892161664 00000100:00100000:3.0:1788802313.110163:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788802313.110171:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892161664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802313.110211:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892161664:12345-0@lo:400:kworker.0 Request processed in 41us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802313.110217:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1788802313.112396:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788802313.112464:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892161664:0@lo:400:kworker.0 00000100:00100000:0.0:1788802313.112481:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892162176:0@lo:400:kworker.0 00000100:00100000:2.0:1788802313.121268:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802313.121902:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892161792 00000100:00100000:3.0:1788802313.121914:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892161792 00000100:00100000:3.0:1788802313.122003:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788802313.122013:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892161792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802313.122099:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892161792:12345-0@lo:400:kworker.0 Request processed in 88us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802313.122107:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1788802313.122197:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802313.124441:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892161792:0@lo:400:kworker.0 00010000:00010000:3.0:1788802313.292588:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788802313.612582:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366559339996ns, next at 367559328808ns, rc = 0 00000100:00100000:0.0:1788802313.612714:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802313.612799:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802313.613268:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892162304 00000100:00100000:2.0:1788802313.613278:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892162304 00000100:00100000:2.0:1788802313.613335:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788802313.613347:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875694892162304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802313.613392:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802313.613477:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875694892162304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802313.613486:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788802313.613653:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892162304:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788802314.326071:0:11962:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000001:00080000:2.0:1788802314.326089:0:11962:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788802314.326098:0:11962:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788802314.326102:0:11962:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000004:00080000:2.0:1788802314.326111:0:11962:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788802314.326133:0:11962:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910d1d1ab300 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788802314.326138:0:11962:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d30dbbd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910d1d1ab9c0 00000020:00080000:2.0:1788802314.326141:0:11962:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d30dbb500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910d41c29400 00000020:00080000:1.0:1788802314.326331:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788802314.326544:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788802314.326640:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802314.326665:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892162432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788802314.326752:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802314.326847:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892162432 00000100:00100000:1.0:1788802314.326855:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892162432 00000100:00100000:1.0:1788802314.326906:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788802314.326915:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875694892162432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788802314.327116:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788802314.327120:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788802307 -> 1788802307 00002000:00010000:1.0:1788802314.327123:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1788802307 -> 1788802307 00002000:00010000:1.0:1788802314.327125:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788802307 -> 1788802307 00002000:00010000:1.0:1788802314.327126:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788802314.327167:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1875694892162432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (415us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788802314.327175:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1788802314.327223:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d3a623100/2, rc 0, transno 4294967312 00000100:00100000:1.0:1788802314.327229:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892162432:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788802314.330836:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788802314.355533:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788802314.355552:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:2.0:1788802315.340575:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802315.664011:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892162560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802315.664122:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802315.664258:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892162560 00000100:00100000:0.0:1788802315.664269:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892162560 00000100:00100000:0.0:1788802315.664382:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788802315.664395:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892162560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802315.664444:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802315.664501:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892162560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802315.664524:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788802315.664562:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802315.664622:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892162560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802315.764647:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802315.764716:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802315.764869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802315.764901:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802315.764930:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802315.764992:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872229504 00000100:00100000:3.0:1788802315.765005:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872229504 00000100:00100000:3.0:1788802315.765083:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872229120 00000100:00100000:3.0:1788802315.765087:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872229120 00000100:00100000:3.0:1788802315.765122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 148 00000100:00100000:3.0:1788802315.765134:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872229504:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802315.765291:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872229504:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 159us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802315.765301:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 148 00000100:00100000:3.0:1788802315.765324:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 149 00000100:00100000:3.0:1788802315.765332:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:2360:x1875694872229120:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802315.765360:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:2360:x1875694872229120:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802315.765367:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 149 00000100:00100000:0.0:1788802315.767551:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872228992 00000100:00100000:0.0:1788802315.767574:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872228992 00000100:00100000:0.0:1788802315.767651:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 294 00000100:00100000:0.0:1788802315.767663:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872228992:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802315.767757:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872228992:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 95us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802315.767765:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 294 00000100:00080000:0.0:1788802315.767810:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802315.788575:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872229248 00000100:00100000:2.0:1788802315.788621:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872229248 00000100:00100000:3.0:1788802315.789042:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872229376 00000100:00100000:3.0:1788802315.789048:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872229376 00000100:00100000:3.0:1788802315.789119:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:3.0:1788802315.789133:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872229248:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802315.789274:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872229248:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 144us (24556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802315.789282:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:3.0:1788802315.789337:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:3.0:1788802315.789346:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872229376:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802315.789390:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872229376:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 46us (24459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802315.789397:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00080000:2.0:1788802315.789624:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802315.789630:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788802316.364394:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802316.569862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802316.569981:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872229632 00000100:00100000:3.0:1788802316.569991:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872229632 00000100:00100000:3.0:1788802316.570059:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 135 00000100:00100000:3.0:1788802316.570086:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:10256:x1875694872229632:12345-192.168.201.57@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788802316.570203:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:10256:x1875694872229632:12345-192.168.201.57@tcp:60:lhsmtool_posix.0 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802316.570211:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 135 00000100:00100000:2.0:1788802316.580424:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802316.583720:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872229888 00000100:00100000:1.0:1788802316.583739:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872229888 00000100:00100000:1.0:1788802316.584381:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:1.0:1788802316.584396:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:10256:x1875694872229888:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788802316.584780:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:10256:x1875694872229888:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 388us (4366us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788802316.584788:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000040:00080000:3.0:1788802317.324606:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802317.324615:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802317.324911:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788802317.324919:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788802317.390902:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802318.220974:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892163072:0@lo:400:kworker.0 00000100:00100000:3.0:1788802318.221047:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802318.221117:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788802318.221124:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892162688:0@lo:400:kworker.0 00000100:00100000:3.0:1788802318.221154:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802318.221176:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892163200:0@lo:400:kworker.0 00000100:00100000:3.0:1788802318.221201:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802318.221233:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892163072 00000100:00100000:3.0:1788802318.221262:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892163072 00000100:00100000:3.0:1788802318.221318:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788802318.221331:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892163072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802318.221384:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892163072:12345-0@lo:400:kworker.0 Request processed in 57us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802318.221391:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788802318.221413:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892163200 00000100:00100000:3.0:1788802318.221417:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892163200 00000100:00100000:3.0:1788802318.221446:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788802318.221453:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892163200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802318.221573:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892162816:0@lo:400:kworker.0 00000100:00100000:1.0:1788802318.221605:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802318.221964:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892163328:0@lo:400:kworker.0 00000100:00100000:1.0:1788802318.221996:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802318.222020:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802318.222027:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892162944:0@lo:400:kworker.0 00000100:00100000:1.0:1788802318.222050:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802318.222080:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892162688 00000100:00100000:1.0:1788802318.222085:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892162688 00000100:00100000:1.0:1788802318.222117:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788802318.222125:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892162688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802318.222159:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892162688:12345-0@lo:400:kworker.0 Request processed in 36us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802318.222166:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788802318.222199:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892162816 00000100:00100000:1.0:1788802318.222203:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892162816 00000100:00100000:1.0:1788802318.222218:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892162944 00000100:00100000:1.0:1788802318.222221:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892162944 00000100:00100000:1.0:1788802318.222260:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788802318.222267:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892162816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802318.222301:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892162816:12345-0@lo:400:kworker.0 Request processed in 35us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802318.222307:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788802318.222320:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788802318.222326:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892162944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802318.222352:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892162944:12345-0@lo:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802318.222371:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788802318.222393:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892163328 00000100:00100000:1.0:1788802318.222397:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892163328 00000100:00100000:1.0:1788802318.222423:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788802318.222429:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892163328:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788802318.222767:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802318.222773:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788802318.222775:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802318.222845:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892162688:0@lo:400:kworker.0 00000100:00100000:2.0:1788802318.222861:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892163072:0@lo:400:kworker.0 00000100:00100000:1.0:1788802318.223207:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892163328:12345-0@lo:400:kworker.0 Request processed in 776us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802318.223216:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788802318.223382:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892163200:12345-0@lo:400:kworker.0 Request processed in 1930us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802318.223389:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788802318.223775:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892163200:0@lo:400:kworker.0 00000100:00100000:2.0:1788802318.226842:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892162944:0@lo:400:kworker.0 00000100:00100000:3.0:1788802318.231201:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892162816:0@lo:400:kworker.0 00000100:00100000:3.0:1788802318.231221:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788802318.231227:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d01218000, transno 4294967309 00000004:00080000:3.0:1788802318.231771:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:3.0:1788802318.231803:0:3313:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff910d3a623100 x1875694892162432/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788802330 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802318.231816:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892163328:0@lo:400:kworker.0 00010000:00010000:1.0:1788802318.420383:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802318.732388:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788802318.732428:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892163456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788802318.732503:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802318.732555:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892163456 00000100:00100000:1.0:1788802318.732566:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892163456 00000100:00100000:1.0:1788802318.732637:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788802318.732646:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892163456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802318.732681:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802318.732723:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892163456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802318.732730:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788802318.732946:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a65a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892163456:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788802318.946728:0:12250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 13:31:57 (1788802317) 00000001:00080000:0.0:1788802319.310978:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788802319.333511:0:11960:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788802319.333843:0:11960:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788802319.334035:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788802319.334049:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788802319.438132:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802320.464843:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802320.692478:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802320.692575:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872230144 00000100:00100000:3.0:1788802320.692601:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872230144 00000100:00100000:3.0:1788802320.692683:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 136 00000100:00100000:3.0:1788802320.692698:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d01218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:11305:x1875694872230144:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788802320.692721:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802320.692751:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee4d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.692830:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c6bb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.692845:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c6bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.692874:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c6bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.692889:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.692897:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.692903:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693121:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693130:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693137:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802320.693147:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788802320.693335:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c6bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693343:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c6bb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693350:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c6bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693356:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802320.693367:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c6bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693375:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c6bb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693387:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910d05184d00) 00010000:00010000:3.0:1788802320.693390:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802320.693395:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c6bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693401:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c6bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693413:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693418:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6c2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693423:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693427:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802320.693430:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693435:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6c2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693441:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff910d02e21e00) 00010000:00010000:3.0:1788802320.693458:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802320.693473:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6c2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693479:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693861:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee4d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693877:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee4d expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.693884:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:3.0:1788802320.693886:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802320.693889:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9c00, rc 0) 00000100:00100000:3.0:1788802320.693967:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d01218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:11305:x1875694872230144:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1274us (1498us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788802320.693975:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 136 00000100:00080000:2.0:1788802320.694316:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802320.707990:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802320.708040:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802320.708174:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872230272 00000100:00100000:3.0:1788802320.708186:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872230272 00000100:00100000:3.0:1788802320.708290:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788802320.708302:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:2359:x1875694872230272:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802320.708319:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802320.708347:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee4d expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802320.708365:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:3.0:1788802320.708381:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802320.708434:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872230400 00000100:00100000:2.0:1788802320.708440:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872230400 00000100:00100000:3.0:1788802320.708455:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:2359:x1875694872230272:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 143us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802320.708464:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788802320.708571:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 137 00000100:00100000:2.0:1788802320.708710:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:11305:x1875694872230400:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788802320.709944:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:11305:x1875694872230400:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 Request processed in 1358us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802320.721299:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 137 00000100:00100000:1.0:1788802320.780656:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788802320.780681:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892163584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802320.780781:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802320.782722:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892163584 00000100:00100000:0.0:1788802320.782750:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892163584 00000100:00100000:0.0:1788802320.782846:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788802320.782857:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892163584:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788802320.783091:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788802320.783129:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802320.783227:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892163584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 372us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802320.783234:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788802320.783480:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892163584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802320.881995:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802320.882032:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802320.882097:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802320.882136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802320.882177:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872230912 00000100:00100000:1.0:1788802320.882186:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872230912 00000100:00100000:1.0:1788802320.882270:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 153 00000100:00100000:1.0:1788802320.882281:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872230912:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802320.882361:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872230912:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802320.882369:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 153 00000100:00100000:2.0:1788802320.882782:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872230784 00000100:00100000:2.0:1788802320.882798:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872230784 00000100:00100000:2.0:1788802320.882832:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872230656 00000100:00100000:2.0:1788802320.882835:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872230656 00000100:00100000:2.0:1788802320.882859:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:2.0:1788802320.882866:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872230784:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802320.882899:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872230784:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 33us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802320.882905:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:2.0:1788802320.882918:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:2.0:1788802320.882925:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872230656:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802320.882953:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872230656:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 29us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802320.882959:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00080000:2.0:1788802320.882980:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788802320.882984:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802320.882987:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802320.883510:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872230528 00000100:00100000:0.0:1788802320.883528:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872230528 00000100:00100000:0.0:1788802320.883602:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 296 00000100:00100000:0.0:1788802320.883649:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872230528:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802320.890274:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872230528:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 6618us (8246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802320.890297:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 296 00000040:00080000:3.0:1788802321.421543:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802321.421555:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802321.421600:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788802321.421608:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788802321.484860:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802322.513926:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802322.889667:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802322.889739:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872231040 00000100:00100000:3.0:1788802322.889753:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872231040 00000100:00100000:3.0:1788802322.889821:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 138 00000100:00100000:3.0:1788802322.889836:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:11348:x1875694872231040:12345-192.168.201.57@tcp:101:lfs.0 00000100:00080000:2.0:1788802322.889853:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788802322.889860:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802322.889885:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee54 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.889969:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.889986:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.889999:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890225:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890234:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890292:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890649:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890658:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890665:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890671:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802322.890676:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890684:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890699:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8300) 00010000:00010000:3.0:1788802322.890702:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802322.890707:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890714:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c6de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890725:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890731:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890746:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890751:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802322.890754:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890761:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890770:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff910d02e21100) 00010000:00010000:3.0:1788802322.890773:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802322.890775:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890788:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890827:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee54 expref: 15 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890838:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8300) 00010000:00010000:3.0:1788802322.890840:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802322.890844:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee54 expref: 15 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.890853:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9c00, rc 0) 00000100:00100000:3.0:1788802322.890940:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:11348:x1875694872231040:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1108us (1281us total) trans 0 rc 301/301 00000100:00100000:3.0:1788802322.890960:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 138 00000100:00100000:1.0:1788802322.905466:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802322.905593:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872231296 00000100:00100000:3.0:1788802322.905613:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872231296 00000100:00100000:3.0:1788802322.905679:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 139 00000100:00100000:3.0:1788802322.905689:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:11348:x1875694872231296:12345-192.168.201.57@tcp:36:lfs.0 00010000:00010000:3.0:1788802322.905744:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802322.905775:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c063 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec94 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.905794:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02db8300) 00010000:00010000:3.0:1788802322.905806:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802322.906053:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.906069:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.906078:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.906089:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.906095:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.906101:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802322.908588:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788802322.908867:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.908880:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.908889:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.909430:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802322.909435:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.909534:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.909551:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d02e21100) 00010000:00010000:3.0:1788802322.909555:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802322.909561:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802322.909568:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9c6ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802322.909588:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f651353c reply state 000000002ae5ff67 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802322.909598:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788802322.909824:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:11348:x1875694872231296:12345-192.168.201.57@tcp:36:lfs.0 Request processed in 4131us (4363us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788802322.909833:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 139 00010000:00010000:0.0:1788802322.917863:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802322.918013:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802322.918021:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802322.918027:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802322.918032:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802322.918040:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802322.918059:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff910d02e21000) 00010000:00010000:0.0:1788802322.918062:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802322.918067:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802322.918074:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9c6f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802323.066691:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802323.066888:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872231424 00000100:00100000:2.0:1788802323.066902:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872231424 00000100:00100000:2.0:1788802323.066975:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 140 00000100:00100000:2.0:1788802323.066986:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+14:11356:x1875694872231424:12345-192.168.201.57@tcp:101:lctl.0 00010000:00010000:2.0:1788802323.067025:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802323.067051:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c6fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee5b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.067157:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c701 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.067184:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.067200:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802323.067262:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788802323.067266:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802323.067294:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.067319:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c6fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee5b expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.067339:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c701 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee5b expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.067349:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d03b55b00) 00010000:00010000:2.0:1788802323.067352:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802323.067356:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f400, rc 0) 00000100:00100000:2.0:1788802323.067427:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:11356:x1875694872231424:12345-192.168.201.57@tcp:101:lctl.0 Request processed in 443us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802323.067434:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 140 00000100:00100000:1.0:1788802323.161974:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802323.162123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872231552 00000100:00100000:0.0:1788802323.162135:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872231552 00000100:00100000:0.0:1788802323.162228:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 141 00000100:00100000:0.0:1788802323.162261:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+15:11362:x1875694872231552:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802323.162283:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802323.162305:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c708 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee62 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162372:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c70f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162389:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c70f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162410:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c70f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162427:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c716 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162434:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162440:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162536:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c71d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162545:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c71d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162551:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c71d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802323.162589:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788802323.162593:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802323.162614:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c71d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162627:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c70f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162634:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c70f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162641:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c70f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162661:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802323.162665:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c70f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162673:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c70f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162684:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d03b55b00) 00010000:00010000:0.0:1788802323.162688:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802323.162693:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c70f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162700:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c70f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162712:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162727:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c716 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162733:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c716 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162738:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802323.162741:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c716 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162747:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c716 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162755:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff910d02db8800) 00010000:00010000:0.0:1788802323.162757:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802323.162760:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c716 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162766:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c716 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162797:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c708 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee62 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162811:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c71d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee62 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.162818:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802323.162821:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788802323.162829:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0200, rc 0) 00000100:00100000:0.0:1788802323.162911:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:11362:x1875694872231552:12345-192.168.201.57@tcp:101:bash.0 Request processed in 673us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802323.162918:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 141 00000100:00100000:0.0:1788802323.171688:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802323.172683:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872231808 00000100:00100000:2.0:1788802323.172696:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872231808 00000100:00100000:2.0:1788802323.172770:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 142 00000100:00100000:2.0:1788802323.172781:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:11362:x1875694872231808:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788802323.172804:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802323.172840:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c724 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee69 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.172980:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c72b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.172997:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c72b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173010:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c72b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173026:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173034:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173041:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788802323.173679:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788802323.173844:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173856:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173865:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173902:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c72b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173920:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c72b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173927:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c72b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173933:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802323.173936:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c72b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173944:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c72b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173956:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:2.0:1788802323.173959:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802323.173964:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c72b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.173971:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c72b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802323.173984:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001475a99 reply state 0000000051785035 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802323.173992:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788802323.174026:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c724 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee69 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.174041:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee69 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.174060:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d03b55800) 00010000:00010000:2.0:1788802323.174063:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802323.174065:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95ec00, rc 0) 00000100:00100000:2.0:1788802323.174497:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:11362:x1875694872231808:12345-192.168.201.57@tcp:101:bash.0 Request processed in 1713us (2817us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788802323.174506:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 142 00010000:00010000:3.0:1788802323.179445:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.179472:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.179481:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.179487:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802323.179492:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.179500:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.179518:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d03b55600) 00010000:00010000:3.0:1788802323.179522:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802323.179527:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.179534:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c732 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802323.180767:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802323.180979:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872231936 00000100:00100000:2.0:1788802323.180990:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872231936 00000100:00100000:2.0:1788802323.181054:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:2.0:1788802323.181065:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872231936:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788802323.181085:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802323.181109:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c747 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee70 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788802323.181140:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802323.181162:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788802323.181167:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802323.181177:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c747 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee70 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.181196:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c747 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee70 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.181209:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f000, rc 0) 00000100:00100000:2.0:1788802323.181384:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872231936:12345-192.168.201.57@tcp:101:bash.0 Request processed in 261us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802323.181413:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00080000:3.0:1788802323.181625:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802323.197043:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802323.197151:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872232064 00000100:00100000:1.0:1788802323.197162:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872232064 00000100:00100000:1.0:1788802323.197227:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:1.0:1788802323.197269:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:11362:x1875694872232064:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788802323.197287:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802323.197304:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee77 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.197343:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c747 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee70 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.197352:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802323.197357:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802323.197362:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.197427:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c747 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee70 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.197442:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c747 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee70 expref: 7 pid: 6687 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802323.197456:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04541880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875694892163712:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802323.197552:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802323.205999:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802323.206127:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872232192 00000100:00100000:1.0:1788802323.206141:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872232192 00010000:00010000:1.0:1788802323.206194:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c747 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee70 expref: 8 pid: 6687 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802323.206289:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:1.0:1788802323.206301:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872232192:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802323.206318:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802323.206357:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c747 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee70 expref: 8 pid: 6687 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.206372:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c747 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee70 expref: 8 pid: 6687 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.206413:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802323.206417:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802323.206443:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.206454:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.206498:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802323.206515:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04541180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1875694892163840:192.168.201.57@tcp:105: 00000100:00100000:1.0:1788802323.206596:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788802323.207443:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9c747 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee70 expref: 8 pid: 6687 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802323.207464:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04541880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875694892163712:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802323.207488:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.207500:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2600, rc 0) 00000100:00100000:2.0:1788802323.207542:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:11362:x1875694872232064:12345-192.168.201.57@tcp:101:bash.0 Request processed in 10305us (10508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802323.207552:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:1.0:1788802323.214386:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04541180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1875694892163840:192.168.201.57@tcp:105: 00010000:00010000:1.0:1788802323.214421:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802323.214486:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872232192:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 8185us (8834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802323.214497:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:1.0:1788802323.217703:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802323.217992:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872232448 00000100:00100000:0.0:1788802323.218004:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872232448 00000100:00100000:0.0:1788802323.218071:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:0.0:1788802323.218082:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:11362:x1875694872232448:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:0.0:1788802323.218508:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:11362:x1875694872232448:12345-192.168.201.57@tcp:35:bash.0 Request processed in 426us (814us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788802323.218516:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:0.0:1788802323.339426:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802323.339786:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872232704 00000100:00100000:1.0:1788802323.339797:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872232704 00000100:00100000:1.0:1788802323.339864:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 143 00000100:00100000:1.0:1788802323.339874:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:11372:x1875694872232704:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802323.339899:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802323.339922:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee7e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802323.340014:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788802323.340170:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c755 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee7e expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.340185:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d03b55b00) 00010000:00010000:1.0:1788802323.340394:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788802323.340410:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee7e expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.340427:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3600, rc 0) 00000100:00100000:1.0:1788802323.340502:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:11372:x1875694872232704:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 629us (1086us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1788802323.340510:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 143 00000100:00100000:2.0:1788802323.341200:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892164096:0@lo:400:kworker.0 00000100:00100000:2.0:1788802323.341281:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802323.341342:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892164608:0@lo:400:kworker.0 00000100:00100000:2.0:1788802323.341368:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802323.341408:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788802323.341415:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892164224:0@lo:400:kworker.0 00000100:00100000:2.0:1788802323.341435:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802323.341464:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892164608 00000100:00100000:2.0:1788802323.341471:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892164608 00000100:00100000:2.0:1788802323.341536:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788802323.341545:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892164608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802323.341603:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892164608:12345-0@lo:400:kworker.0 Request processed in 60us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802323.341611:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788802323.341631:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788802323.341662:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788802323.341668:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d3a623100, transno 4294967312 00000100:00100000:2.0:1788802323.341680:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892164608:0@lo:400:kworker.0 00000100:00100000:0.0:1788802323.341782:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892164096 00000100:00100000:0.0:1788802323.341788:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892164096 00000100:00100000:0.0:1788802323.341816:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892164224 00000100:00100000:0.0:1788802323.341819:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892164224 00000100:00080000:2.0:1788802323.341833:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802323.341843:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788802323.341850:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892164096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802323.341905:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892164096:12345-0@lo:400:kworker.0 Request processed in 55us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802323.341910:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788802323.341922:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788802323.341927:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892164224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802323.341949:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892164096:0@lo:400:kworker.0 00000100:00100000:0.0:1788802323.341953:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892164224:12345-0@lo:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802323.341965:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892164224:0@lo:400:kworker.0 00000100:00100000:0.0:1788802323.341970:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788802323.342184:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892164352:0@lo:400:kworker.0 00000100:00100000:3.0:1788802323.342234:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802323.342293:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788802323.342300:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892163968:0@lo:400:kworker.0 00000100:00100000:3.0:1788802323.342327:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802323.342363:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892164480:0@lo:400:kworker.0 00000100:00100000:3.0:1788802323.342385:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802323.343017:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892164480 00000100:00100000:2.0:1788802323.343017:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892164352 00000100:00100000:3.0:1788802323.343026:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892164480 00000100:00100000:2.0:1788802323.343026:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892164352 00000100:00100000:2.0:1788802323.343093:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788802323.343103:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892164352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802323.343166:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892164352:12345-0@lo:400:kworker.0 Request processed in 65us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802323.343173:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788802323.343261:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892163968 00000100:00100000:0.0:1788802323.343265:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892163968 00000100:00100000:0.0:1788802323.343697:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788802323.343709:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892163968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802323.343751:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3311:x1875694892163968:12345-0@lo:400:kworker.0 Request processed in 47us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802323.343757:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788802323.344380:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:3311:1875694892163968:0@lo:400:kworker.0 00000100:00100000:1.0:1788802323.344409:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892164352:0@lo:400:kworker.0 00000100:00080000:2.0:1788802323.349260:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788802323.349277:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802323.351054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788802323.351070:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892164480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802323.351203:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875694892164480:12345-0@lo:400:kworker.0 Request processed in 137us (8816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802323.351210:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788802323.352039:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892164480:0@lo:400:kworker.0 00000100:00100000:2.0:1788802323.358455:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802323.359049:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872232960 00000100:00100000:0.0:1788802323.359063:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872232960 00000100:00100000:0.0:1788802323.359134:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:0.0:1788802323.359144:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:11372:x1875694872232960:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788802323.359505:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:11372:x1875694872232960:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 361us (1059us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788802323.359512:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:2.0:1788802323.494415:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802323.496601:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872233088 00000100:00100000:0.0:1788802323.496616:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872233088 00000100:00100000:0.0:1788802323.496705:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 144 00000100:00100000:0.0:1788802323.496721:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:11378:x1875694872233088:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802323.496754:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802323.496787:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee85 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.496881:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c76a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.496914:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.496927:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802323.496971:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788802323.496975:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802323.496994:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.497031:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee85 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.497069:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c76a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee85 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.497079:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802323.497083:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788802323.497087:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0c00, rc 0) 00000100:00100000:0.0:1788802323.497191:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:11378:x1875694872233088:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 475us (2801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802323.497200:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 144 00000100:00100000:1.0:1788802323.505633:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802323.507902:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872233344 00000100:00100000:2.0:1788802323.507923:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872233344 00000100:00100000:2.0:1788802323.508005:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 145 00000100:00100000:2.0:1788802323.508016:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:11378:x1875694872233344:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802323.508041:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802323.508093:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c771 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee8c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.508195:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.508210:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.508221:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802323.508233:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788802323.508410:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c771 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee8c expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.508430:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee8c expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.508439:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d03b55800) 00010000:00010000:2.0:1788802323.508442:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802323.508445:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f000, rc 0) 00000100:00100000:2.0:1788802323.508505:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:11378:x1875694872233344:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 491us (2888us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788802323.508512:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 145 00000100:00100000:3.0:1788802323.524914:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802323.525130:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872233600 00000100:00100000:0.0:1788802323.525146:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872233600 00000100:00100000:0.0:1788802323.525230:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 146 00000100:00100000:0.0:1788802323.525310:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:11378:x1875694872233600:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802323.525348:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802323.525420:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c786 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee93 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.525613:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c78d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.525634:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c78d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.525650:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c78d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802323.525667:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788802323.525841:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c786 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee93 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.525864:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c78d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee93 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.525875:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d03b55800) 00010000:00010000:0.0:1788802323.525878:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788802323.525882:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1000, rc 0) 00000100:00100000:0.0:1788802323.525968:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11378:x1875694872233600:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 665us (1071us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788802323.525977:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 146 00000100:00100000:1.0:1788802323.530557:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802323.530857:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872233728 00000100:00100000:3.0:1788802323.530874:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872233728 00000100:00100000:3.0:1788802323.530990:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788802323.531008:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:2358:x1875694872233728:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802323.531036:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802323.531081:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c778 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee8c expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.531113:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d03b55800) 00010000:00010000:3.0:1788802323.531121:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802323.531363:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:2358:x1875694872233728:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 358us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802323.531373:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00010000:00010000:0.0:1788802323.534779:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802323.545042:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802323.546201:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872233856 00000100:00100000:3.0:1788802323.546224:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872233856 00000100:00100000:3.0:1788802323.546449:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:3.0:1788802323.546463:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872233856:12345-192.168.201.57@tcp:1:lfs.0 00010000:00010000:3.0:1788802323.546547:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.546585:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.546603:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802323.546608:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788802323.546614:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.546665:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.546681:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 6 pid: 6688 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802323.546699:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875694892164736:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802323.547047:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d10fd0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788802323.555753:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802323.556082:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a90a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1875694892164736:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802323.556136:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802323.556751:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872233984 00000100:00100000:0.0:1788802323.556766:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872233984 00002000:00100000:0.0:1788802323.556843:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff910d04541880 x1875694872233984/t0(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:464/0 lens 504/0 e 0 to 0 dl 1788802334 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788802323.556880:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d04541880 with x1875694872233984 ext(0->12) 00010000:00010000:0.0:1788802323.556890:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 7 pid: 6688 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.556910:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 7 pid: 6688 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788802323.556919:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910d04541880 00000100:00100000:0.0:1788802323.557011:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:0.0:1788802323.557023:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2357:x1875694872233984:12345-192.168.201.57@tcp:4:lfs.0 00000100:00100000:0.0:1788802323.558969:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2357:x1875694872233984:12345-192.168.201.57@tcp:4:lfs.0 Request processed in 1932us (3218us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788802323.558987:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00002000:00100000:0.0:1788802323.559004:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff910d04541880 x1875694872233984/t4294967305(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:464/0 lens 504/448 e 0 to 0 dl 1788802334 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788802323.559015:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d04541880 with x1875694872233984 ext(0->12) 00010000:00010000:0.0:1788802323.559029:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 9 pid: 6688 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.559054:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 9 pid: 6688 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788802323.559063:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910d04541880 00000100:00100000:1.0:1788802323.565586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802323.565783:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872234112 00000100:00100000:3.0:1788802323.565806:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872234112 00010000:00010000:3.0:1788802323.565864:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 9 pid: 6688 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802323.565938:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:3.0:1788802323.565950:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2357:x1875694872234112:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802323.565971:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788802323.566000:0:7624:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788802323.566004:0:7624:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788802323 00002000:00010000:3.0:1788802323.566006:0:7624:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788802323 00002000:00010000:3.0:1788802323.566009:0:7624:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788802323 00010000:00010000:3.0:1788802323.566017:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 9 pid: 6688 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.566034:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 9 pid: 6688 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.566065:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ea443e1/0x6ecba1490fc9c74e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee77 expref: 9 pid: 6688 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.566089:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788802323.566094:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788802323.566102:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.566114:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.566162:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802323.566301:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2357:x1875694872234112:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 353us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802323.566310:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 60 00010000:00010000:2.0:1788802323.566722:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.566736:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.566778:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.566799:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.566809:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.566816:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802323.566821:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.566832:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.566848:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.566857:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eb52d8f/0x6ecba1490fc9c79b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802323.566932:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2357:x1875694872233856:12345-192.168.201.57@tcp:1:lfs.0 Request processed in 20469us (21906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802323.566942:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:2.0:1788802323.575955:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802323.576033:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872234368 00000100:00100000:0.0:1788802323.576060:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872234368 00000100:00100000:1.0:1788802323.577469:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:1.0:1788802323.577497:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:11378:x1875694872234368:12345-192.168.201.57@tcp:35:lfs.0 00000004:00010000:1.0:1788802323.577604:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c78d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee93 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788802323.578021:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788802323.578081:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788802323.578795:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788802323.578873:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.578895:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee69 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.578907:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.578960:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee69 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.578982:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee69 expref: 29 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802323.579000:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ae680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875694892164864:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802323.579136:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788802323.582961:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802323.583039:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872234496 00000100:00100000:3.0:1788802323.583059:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872234496 00000100:00100000:1.0:1788802323.583118:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ae680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875694892164864:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802323.583168:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.583209:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee69 expref: 30 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802323.583375:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:3.0:1788802323.583390:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:2360:x1875694872234496:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802323.583432:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802323.583452:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee69 expref: 30 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.583469:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee69 expref: 30 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.583500:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c739 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edee69 expref: 30 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.583523:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d03b55800) 00010000:00010000:3.0:1788802323.583530:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.583542:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.583552:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802323.583622:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802323.583658:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802323.583669:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802323.583719:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:2360:x1875694872234496:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 331us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802323.583728:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000001:00080000:1.0:1788802323.584127:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788802323.585017:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788802323.585181:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ae680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875694892164992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788802323.585314:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802323.585353:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d04de3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788802323.585376:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892164992 00000100:00100000:0.0:1788802323.585387:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892164992 00000100:00100000:0.0:1788802323.585473:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788802323.585486:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875694892164992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788802323.585685:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ae680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875694892164992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788802323.585804:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875694892164992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802323.585814:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00080000:2.0:1788802323.586457:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788802323.586544:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875694892165120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788802323.593953:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802323.594066:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788802323.594135:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892165120 00000100:00100000:2.0:1788802323.594148:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892165120 00000100:00100000:2.0:1788802323.594220:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788802323.594227:0:5847:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788802323.594260:0:5847:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788802323.594262:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875694892165120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788802323.596148:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875694892165120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1909us (2200us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788802323.596166:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788802323.596827:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875694892165120:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788802323.596957:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788802323.597028:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.597042:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.597052:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.597059:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802323.597066:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.597077:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.597099:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d03b55800) 00010000:00010000:0.0:1788802323.597181:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788802323.597191:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.597199:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9c7a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788802323.597875:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788802323.598008:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788802323.598024:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376544784804ns, next at 377544782065ns, rc = 0 00000001:00080000:0.0:1788802323.598032:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788802323.598080:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d03b55800) 00010000:00010000:0.0:1788802323.598083:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788802323.598094:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c78d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee93 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802323.598880:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11378:x1875694872234368:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 21390us (22935us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788802323.598893:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00000020:00080000:0.0:1788802323.598900:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788802323.602827:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802323.602937:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872234624 00000100:00100000:2.0:1788802323.602952:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872234624 00000100:00100000:2.0:1788802323.603063:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 147 00000100:00100000:2.0:1788802323.603077:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11378:x1875694872234624:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802323.603113:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802323.603157:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c7a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edee9a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.603272:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee9a expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.603292:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee9a expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.603329:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802323.603360:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788802323.603366:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95ec00, rc 0) 00000100:00100000:2.0:1788802323.603473:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:11378:x1875694872234624:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 399us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802323.603481:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 147 00000100:00100000:1.0:1788802323.606999:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802323.607298:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872234880 00000100:00100000:3.0:1788802323.607313:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872234880 00000100:00100000:3.0:1788802323.607449:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788802323.607464:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:11378:x1875694872234880:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802323.607831:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:11378:x1875694872234880:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 368us (849us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788802323.607842:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:3.0:1788802323.676055:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802323.676305:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872235136 00000100:00100000:2.0:1788802323.676329:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872235136 00000100:00100000:2.0:1788802323.676418:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 148 00000100:00100000:2.0:1788802323.676558:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:11388:x1875694872235136:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802323.676657:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802323.676687:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c7b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeea1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802323.676813:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788802323.676980:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c7b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea1 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.676997:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d03b55b00) 00010000:00010000:2.0:1788802323.677001:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788802323.677008:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c7b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea1 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.677026:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95e600, rc 0) 00000100:00100000:2.0:1788802323.677112:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:11388:x1875694872235136:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 562us (1073us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788802323.680690:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802323.680769:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 148 00000100:00100000:2.0:1788802323.681073:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872235264 00000100:00100000:2.0:1788802323.681106:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872235264 00000100:00100000:0.0:1788802323.681275:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 149 00000100:00100000:0.0:1788802323.681291:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:11388:x1875694872235264:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:0.0:1788802323.681445:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681470:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681487:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681518:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681526:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681534:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681673:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681683:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681691:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788802323.681752:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681769:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681778:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681786:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681792:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802323.681797:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681813:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681828:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802323.681831:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802323.681838:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681844:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681861:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681868:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681875:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681880:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802323.681883:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681890:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681898:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02db8800) 00010000:00010000:0.0:1788802323.681900:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802323.681903:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681919:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681937:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681944:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681951:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681955:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802323.681958:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681964:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681972:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:0.0:1788802323.681974:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802323.681977:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.681983:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802323.682094:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:11388:x1875694872235264:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 804us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802323.682102:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 149 00000100:00100000:1.0:1788802323.687944:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802323.688066:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872235520 00000100:00100000:3.0:1788802323.688081:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872235520 00000100:00100000:3.0:1788802323.688230:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:3.0:1788802323.688278:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:11388:x1875694872235520:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802323.688947:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:11388:x1875694872235520:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 669us (1017us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788802323.688957:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:3.0:1788802323.744998:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802323.745379:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872235776 00000100:00100000:0.0:1788802323.745405:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872235776 00000100:00100000:0.0:1788802323.745774:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 150 00000100:00100000:0.0:1788802323.745789:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:11391:x1875694872235776:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802323.745826:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802323.745855:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeea8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.745961:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7da lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.745981:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.745996:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746013:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746020:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746027:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746555:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746570:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746668:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802323.746681:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788802323.746829:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746838:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746845:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746852:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802323.746858:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746867:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746883:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802323.746887:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802323.746894:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746901:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c7da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746921:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746928:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746943:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746949:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802323.746953:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746961:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746970:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02db8800) 00010000:00010000:0.0:1788802323.746972:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802323.746975:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.746981:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9c7e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.747063:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9c7d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea8 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.747079:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea8 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802323.747087:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:0.0:1788802323.747090:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802323.747093:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0400, rc 0) 00000100:00100000:1.0:1788802323.749168:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+38:11391:x1875694872235776:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 3367us (4171us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788802323.749185:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 150 00000100:00100000:0.0:1788802323.754383:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802323.754748:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872235904 00000100:00100000:2.0:1788802323.754764:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872235904 00000100:00100000:2.0:1788802323.754846:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 151 00000100:00100000:2.0:1788802323.754859:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+38:11391:x1875694872235904:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:2.0:1788802323.754959:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.754982:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.754999:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.755033:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.755041:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.755048:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.755055:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802323.755060:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.755069:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.755083:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802323.755087:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788802323.755114:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802323.755122:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802323.755284:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+38:11391:x1875694872235904:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 427us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802323.755294:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 151 00000100:00100000:2.0:1788802323.759807:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802323.760010:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872236160 00000100:00100000:1.0:1788802323.760027:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872236160 00000100:00100000:1.0:1788802323.760109:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:1.0:1788802323.760122:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+38:11391:x1875694872236160:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:1.0:1788802323.760824:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+39:11391:x1875694872236160:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 700us (1386us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788802323.760835:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:1.0:1788802323.852846:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892165248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802323.852961:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802323.853263:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892165248 00000100:00100000:0.0:1788802323.853292:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892165248 00000100:00100000:0.0:1788802323.853379:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788802323.853399:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892165248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788802323.853461:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802323.862670:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892165248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9264us (9692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802323.862689:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788802323.866938:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892165248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802324.133079:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802324.133173:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872236416 00000100:00100000:3.0:1788802324.133187:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872236416 00000100:00080000:2.0:1788802324.133264:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802324.133317:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 152 00000100:00100000:2.0:1788802324.133797:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+39:11422:x1875694872236416:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:2.0:1788802324.133830:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802324.133856:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeeaf expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.134201:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c804 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.134218:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.134231:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802324.134267:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788802324.134419:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c7fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeaf expref: 42 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.134508:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeaf expref: 41 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.134532:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802324.134536:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802324.134540:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f600, rc 0) 00000100:00100000:2.0:1788802324.134711:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+41:11422:x1875694872236416:12345-192.168.201.57@tcp:101:cat.0 Request processed in 1366us (1650us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788802324.134721:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 152 00000100:00100000:0.0:1788802324.139621:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802324.139674:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802324.139779:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872236672 00000100:00100000:3.0:1788802324.139797:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872236672 00000100:00100000:3.0:1788802324.139919:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:3.0:1788802324.139933:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+41:11422:x1875694872236672:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:2.0:1788802324.140086:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872236800 00000100:00100000:2.0:1788802324.140091:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872236800 00000100:00100000:2.0:1788802324.140141:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:2.0:1788802324.140149:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+42:2357:x1875694872236800:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802324.140163:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802324.140196:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c804 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeaf expref: 42 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.140220:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802324.140227:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802324.140316:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+41:2357:x1875694872236800:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 166us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802324.140325:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788802324.140456:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+41:11422:x1875694872236672:12345-192.168.201.57@tcp:35:cat.0 Request processed in 526us (1617us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788802324.140757:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:1.0:1788802324.212840:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802324.212994:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872237056 00000100:00100000:2.0:1788802324.213008:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872237056 00000100:00100000:2.0:1788802324.213140:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 153 00000100:00100000:2.0:1788802324.213155:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+41:11428:x1875694872237056:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:2.0:1788802324.213190:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802324.213194:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788802324.213298:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c76a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee85 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.213337:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:2.0:1788802324.213345:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802324.213365:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c812 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeeb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.213542:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.213560:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea8 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.213570:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.213625:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea8 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.213643:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea8 expref: 41 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802324.213660:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892165376:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802324.213791:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1020b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788802324.217172:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892165376:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802324.217223:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802324.220326:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802324.220593:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872237184 00000100:00100000:0.0:1788802324.220608:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872237184 00010000:00010000:0.0:1788802324.220672:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea8 expref: 42 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802324.220724:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:0.0:1788802324.220737:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+42:2360:x1875694872237184:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788802324.220759:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802324.220768:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea8 expref: 42 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.220784:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea8 expref: 42 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.220816:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c7e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeea8 expref: 42 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.220838:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:0.0:1788802324.220865:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.220877:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.220886:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.221089:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802324.221171:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+41:2360:x1875694872237184:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 437us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802324.221181:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 62 00010000:00010000:2.0:1788802324.221431:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.221505:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802324.221531:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788802324.221751:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c812 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeb6 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.221774:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeb6 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.221783:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802324.221788:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788802324.221790:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95f000, rc 0) 00000100:00100000:2.0:1788802324.221829:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+41:11428:x1875694872237056:12345-192.168.201.57@tcp:101:dd.0 Request processed in 8679us (9008us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788802324.221835:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 153 00000100:00100000:1.0:1788802324.225780:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802324.225858:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872237440 00000100:00100000:2.0:1788802324.225872:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872237440 00000100:00100000:2.0:1788802324.226001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 154 00000100:00100000:2.0:1788802324.226015:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+41:11428:x1875694872237440:12345-192.168.201.57@tcp:36:dd.0 00010000:00010000:2.0:1788802324.226568:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.226592:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.226629:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788802324.226700:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788802324.226732:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3070959 reply state 00000000287e3673 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802324.226743:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788802324.226856:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+44:11428:x1875694872237440:12345-192.168.201.57@tcp:36:dd.0 Request processed in 844us (1094us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788802324.226862:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 154 00000020:00080000:2.0:1788802324.226868:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788802324.229663:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.229687:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.229698:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.229705:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802324.229711:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.229720:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.229743:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802324.229747:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802324.229776:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.229784:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c827 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788802324.457290:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000004:00080000:1.0:1788802324.457326:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:1.0:1788802324.457350:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000001:00080000:1.0:1788802324.457376:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000020:00080000:1.0:1788802324.457757:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910d3fad3000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788802324.457762:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d08358500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910d3fad3d80 00000020:00080000:1.0:1788802324.457765:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d08358d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910d343df000 00000100:00100000:3.0:1788802324.458831:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802324.459020:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892165504:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788802324.459096:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802324.459747:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892165504 00000100:00100000:0.0:1788802324.459758:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892165504 00000100:00100000:0.0:1788802324.459878:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788802324.459891:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875694892165504:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1788802324.459918:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00002000:00080000:0.0:1788802324.459925:0:8127:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788802324.459969:0:8127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ef513, atime: 0x6a9ef513, ctime: 0x6a9ef513, blocks: 0xb 00010000:00010000:0.0:1788802324.459979:0:8127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c82e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.459995:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1788802324.460000:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802324.460008:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.460036:0:8127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.460069:0:8127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.460077:0:8127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.460096:0:8127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1788802324.460287:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788802324.460790:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875694892165504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 899us (1691us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788802324.460799:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788802324.460819:0:6703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788802324.460828:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.460838:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802324.460843:0:6703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.460852:0:6703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c82e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.460871:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c82e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.460879:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9c82e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.460919:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802324.460922:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802324.460923:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788802324.460930:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d41db4e00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788802324.460943:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892165504:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788802324.462993:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788802324.463013:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1788802324.516105:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802324.516282:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872237568 00000100:00100000:3.0:1788802324.516292:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872237568 00000100:00100000:3.0:1788802324.516427:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 155 00000100:00100000:3.0:1788802324.516439:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+16:11442:x1875694872237568:12345-192.168.201.57@tcp:101:stat.0 00010000:00010000:3.0:1788802324.516472:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802324.516493:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c835 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeebd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516557:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c83c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516583:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c83c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516595:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c83c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516609:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516617:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516622:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516911:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516922:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeb6 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516930:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516961:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeb6 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802324.516975:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeb6 expref: 17 pid: 5843 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802324.516988:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a91180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892165632:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802324.517110:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d01254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788802324.521224:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802324.521561:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a91180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892165632:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802324.521631:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872237824 00000100:00100000:1.0:1788802324.521639:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872237824 00000100:00100000:1.0:1788802324.521702:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:1.0:1788802324.521714:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:5599:x1875694872237824:12345-192.168.201.57@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1788802324.521763:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802324.522109:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:5599:x1875694872237824:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 396us (893us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788802324.522117:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:0.0:1788802324.525219:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802324.525411:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872237952 00000100:00100000:2.0:1788802324.525421:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872237952 00010000:00010000:2.0:1788802324.525731:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeb6 expref: 19 pid: 5843 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802324.525767:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:2.0:1788802324.525778:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08318850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:2360:x1875694872237952:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802324.525792:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802324.525798:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeb6 expref: 19 pid: 5843 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.525811:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeb6 expref: 19 pid: 5843 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.525834:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c819 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeb6 expref: 19 pid: 5843 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.525852:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802324.525858:0:7624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.525881:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.525888:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.525931:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802324.525994:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08318850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:2360:x1875694872237952:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 218us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802324.526001:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 63 00010000:00010000:1.0:1788802324.526069:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526087:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802324.526133:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788802324.526138:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802324.526164:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526178:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526187:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c83c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526192:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c83c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526205:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c83c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526210:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802324.526214:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c83c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526222:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c83c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526230:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:1.0:1788802324.526233:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802324.526255:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c83c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526262:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9c83c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526283:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526577:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c843 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526584:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526588:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802324.526592:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526607:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c843 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526615:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02e21100) 00010000:00010000:1.0:1788802324.526617:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802324.526621:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c843 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526625:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9c843 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526666:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9c835 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeebd expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526680:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeebd expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802324.526687:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:1.0:1788802324.526689:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802324.526692:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8600, rc 0) 00000100:00100000:1.0:1788802324.526725:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:11442:x1875694872237568:12345-192.168.201.57@tcp:101:stat.0 Request processed in 10290us (10631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802324.526732:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 155 00010000:00010000:3.0:1788802324.556539:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802324.601529:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802324.601815:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872238208 00000100:00100000:0.0:1788802324.601827:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872238208 00000100:00100000:0.0:1788802324.601885:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 156 00000100:00100000:0.0:1788802324.601895:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:11448:x1875694872238208:12345-192.168.201.57@tcp:36:truncate.0 00010000:00010000:0.0:1788802324.601954:0:9415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802324.601981:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9c84a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeebd expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.602001:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:0.0:1788802324.602006:0:9415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788802324.602209:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.602223:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.602293:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802324.602348:0:9415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788802324.602386:0:9415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8267d42 reply state 00000000305c7d85 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802324.602395:0:9415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788802324.602516:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:11448:x1875694872238208:12345-192.168.201.57@tcp:36:truncate.0 Request processed in 621us (996us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788802324.602524:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 156 00000020:00080000:0.0:1788802324.602529:0:9415:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788802324.607437:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.607503:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.607512:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.607638:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802324.607644:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.607652:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.608418:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802324.608424:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802324.608437:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802324.608473:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c851 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802324.816018:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802324.816301:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872238336 00000100:00100000:0.0:1788802324.816311:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872238336 00000100:00100000:0.0:1788802324.816435:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 157 00000100:00100000:0.0:1788802324.816447:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:11462:x1875694872238336:12345-192.168.201.57@tcp:101:stat.0 00010000:00010000:0.0:1788802324.816475:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802324.816500:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c858 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeec4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.816599:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c85f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.816615:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c85f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.816626:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c85f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.816650:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.816657:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.816663:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.816960:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.816969:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.816977:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802324.817017:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788802324.817035:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802324.817060:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817073:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817082:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c85f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817088:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c85f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817105:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c85f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817111:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802324.817117:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c85f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817127:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c85f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817142:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802324.817146:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802324.817151:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c85f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817158:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c85f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817172:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817178:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c866 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817184:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817189:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802324.817192:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817207:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817214:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02db8b00) 00010000:00010000:0.0:1788802324.817217:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802324.817219:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c866 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817225:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817312:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c858 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeec4 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817327:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeec4 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.817334:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:0.0:1788802324.817336:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802324.817338:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1a00, rc 0) 00000100:00100000:0.0:1788802324.817417:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:11462:x1875694872238336:12345-192.168.201.57@tcp:101:stat.0 Request processed in 972us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802324.817424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 157 00000100:00100000:3.0:1788802324.969210:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802324.969669:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872238592 00000100:00100000:0.0:1788802324.969682:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872238592 00000100:00100000:0.0:1788802324.969757:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 158 00000100:00100000:0.0:1788802324.969768:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:11472:x1875694872238592:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802324.969807:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802324.969834:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeecb expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802324.969933:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788802324.970071:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c874 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeecb expref: 21 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.970086:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d03b55b00) 00010000:00010000:0.0:1788802324.970090:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788802324.970095:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeecb expref: 21 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802324.970110:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0e00, rc 0) 00000100:00100000:0.0:1788802324.970179:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:11472:x1875694872238592:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 413us (980us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788802324.970187:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 158 00000100:00100000:3.0:1788802324.972556:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802324.972653:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872238848 00000100:00100000:0.0:1788802324.972664:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872238848 00000100:00100000:0.0:1788802324.972725:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:0.0:1788802324.972736:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:11472:x1875694872238848:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788802324.972986:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:11472:x1875694872238848:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 251us (441us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788802324.972994:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:1.0:1788802325.091204:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802325.091348:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872239104 00000100:00100000:0.0:1788802325.091358:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872239104 00000100:00100000:0.0:1788802325.091440:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 159 00000100:00100000:0.0:1788802325.091465:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:11478:x1875694872239104:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802325.091496:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802325.091522:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c882 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeed2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.091632:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.091648:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeec4 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.091657:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.091691:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeec4 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.091705:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeec4 expref: 22 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802325.091720:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41db5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892165760:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802325.091841:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08aff180 going to sleep for 11 seconds 00000100:00100000:3.0:1788802325.095932:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802325.096055:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872239232 00000100:00100000:1.0:1788802325.096065:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872239232 00010000:00010000:1.0:1788802325.096103:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeec4 expref: 23 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802325.096159:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:1.0:1788802325.096168:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:2360:x1875694872239232:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802325.096184:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802325.096192:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeec4 expref: 23 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.096205:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeec4 expref: 23 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.096226:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:1.0:1788802325.096231:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.096267:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.096274:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.096301:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802325.096354:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:2360:x1875694872239232:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 187us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802325.096360:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00010000:00010000:0.0:1788802325.097524:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c86d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeec4 expref: 22 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802325.097548:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41db5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892165760:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802325.097580:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.097605:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.097612:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802325.097633:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788802325.097788:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9c882 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed2 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.097805:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed2 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.097814:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:0.0:1788802325.097817:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788802325.097821:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0400, rc 0) 00000100:00100000:0.0:1788802325.097881:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:11478:x1875694872239104:12345-192.168.201.57@tcp:101:bash.0 Request processed in 6418us (6687us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788802325.097890:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 159 00000100:00100000:3.0:1788802325.107580:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802325.113012:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872239488 00000100:00100000:0.0:1788802325.113031:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872239488 00000100:00100000:0.0:1788802325.113119:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 160 00000100:00100000:0.0:1788802325.113132:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:11478:x1875694872239488:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:1.0:1788802325.114977:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.115000:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.115038:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788802325.115097:0:9415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788802325.115125:0:9415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c912783f reply state 0000000039f03887 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802325.115136:0:9415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788802325.115281:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:11478:x1875694872239488:12345-192.168.201.57@tcp:36:bash.0 Request processed in 2148us (7721us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788802325.115290:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 160 00000020:00080000:1.0:1788802325.115297:0:9415:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788802325.118103:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.118121:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.118129:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.118134:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802325.118139:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.118146:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.118166:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802325.118169:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802325.118174:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.118179:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9c897 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802325.121175:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802325.121302:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872239616 00000100:00100000:1.0:1788802325.121313:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872239616 00000100:00100000:1.0:1788802325.121364:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 161 00000100:00100000:1.0:1788802325.121387:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:11478:x1875694872239616:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788802325.121720:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802325.121745:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c89e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeed9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.121838:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.121853:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed2 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.121862:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.121908:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed2 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.121923:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed2 expref: 25 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802325.121937:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892165888:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802325.122163:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d358d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788802325.124908:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892165888:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802325.124941:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802325.125205:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802325.125287:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872239744 00000100:00100000:2.0:1788802325.125300:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872239744 00010000:00010000:2.0:1788802325.125337:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed2 expref: 26 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802325.125400:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:2.0:1788802325.125410:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:2359:x1875694872239744:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802325.125432:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802325.125440:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed2 expref: 26 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.125453:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed2 expref: 26 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.125475:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9c889 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed2 expref: 26 pid: 5843 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.125491:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802325.125496:0:7624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.125506:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.125514:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.125586:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802325.125652:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:2359:x1875694872239744:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 243us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802325.125659:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 65 00010000:00010000:1.0:1788802325.127777:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.127797:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802325.127858:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788802325.127862:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802325.127885:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.127928:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c89e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed9 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.127951:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed9 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.127984:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:1.0:1788802325.127987:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802325.127990:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3e00, rc 0) 00000100:00100000:1.0:1788802325.128163:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:11478:x1875694872239616:12345-192.168.201.57@tcp:101:bash.0 Request processed in 6777us (6999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802325.128172:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 161 00000100:00100000:0.0:1788802325.139612:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802325.139949:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872240000 00000100:00100000:3.0:1788802325.139965:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872240000 00000100:00100000:3.0:1788802325.140025:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:3.0:1788802325.140038:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:11478:x1875694872240000:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:3.0:1788802325.140307:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:11478:x1875694872240000:12345-192.168.201.57@tcp:35:bash.0 Request processed in 270us (704us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788802325.140316:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:3.0:1788802325.233634:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802325.233810:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872240256 00000100:00100000:2.0:1788802325.233836:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872240256 00000100:00100000:2.0:1788802325.233910:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 162 00000100:00100000:2.0:1788802325.233923:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:11488:x1875694872240256:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802325.233951:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802325.233974:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c8ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeee0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802325.234069:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788802325.234194:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c8ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeee0 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.234207:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d03b55b00) 00010000:00010000:2.0:1788802325.234209:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788802325.234214:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c8ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeee0 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.234227:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3f95e600, rc 0) 00000100:00100000:2.0:1788802325.234465:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11488:x1875694872240256:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 544us (844us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788802325.234472:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 162 00000100:00100000:2.0:1788802325.238775:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802325.238870:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872240384 00000100:00100000:0.0:1788802325.238881:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872240384 00000100:00100000:0.0:1788802325.238992:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 163 00000100:00100000:0.0:1788802325.239018:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11488:x1875694872240384:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:0.0:1788802325.239108:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c8ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239125:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239138:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239153:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c8c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239161:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239168:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239688:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239698:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239705:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788802325.239747:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239760:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239771:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c8ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239777:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239782:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802325.239786:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239793:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c8ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239804:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802325.239807:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802325.239812:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c8ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239818:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c8ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239854:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239860:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239866:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239870:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802325.239881:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239886:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239893:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02db8b00) 00010000:00010000:0.0:1788802325.239896:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802325.239899:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c8c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239905:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c8c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239920:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239926:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239931:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239936:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802325.239939:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239945:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239953:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:0.0:1788802325.239954:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802325.239964:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802325.239971:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9c8c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802325.240053:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11488:x1875694872240384:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 1035us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802325.240062:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 163 00000100:00100000:3.0:1788802325.243007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802325.243106:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872240640 00000100:00100000:2.0:1788802325.243118:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872240640 00000100:00100000:2.0:1788802325.243176:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:2.0:1788802325.243188:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11488:x1875694872240640:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788802325.243487:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:11488:x1875694872240640:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 299us (492us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788802325.243512:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:0.0:1788802325.284618:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802325.284767:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872240896 00000100:00100000:2.0:1788802325.284778:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872240896 00000100:00100000:2.0:1788802325.284841:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 164 00000100:00100000:2.0:1788802325.284851:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:11491:x1875694872240896:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802325.284878:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802325.284902:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c8cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeee7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.284974:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c8d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.284988:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285000:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285014:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c8dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285021:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285028:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285382:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9c8e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285402:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9c8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285409:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9c8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802325.285419:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788802325.285518:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285526:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c8d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285533:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285538:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802325.285543:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285550:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c8d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285573:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:2.0:1788802325.285576:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802325.285582:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c8d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285589:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f000/0x6ecba1490fc9c8d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285603:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285615:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c8dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285620:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c8dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285625:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802325.285628:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c8dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285634:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c8dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285641:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d013ef300) 00010000:00010000:2.0:1788802325.285643:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802325.285646:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c8dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285651:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f600/0x6ecba1490fc9c8dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285691:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e600/0x6ecba1490fc9c8cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeee7 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285704:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9c8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeee7 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.285712:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802325.285714:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802325.285722:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216ea00, rc 0) 00000100:00100000:2.0:1788802325.286037:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:11491:x1875694872240896:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1187us (1429us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788802325.286046:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 164 00000100:00100000:2.0:1788802325.289931:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802325.290066:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872241024 00000100:00100000:1.0:1788802325.290076:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872241024 00000100:00100000:1.0:1788802325.290136:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 165 00000100:00100000:1.0:1788802325.290146:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:11491:x1875694872241024:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:1.0:1788802325.290215:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.290234:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.290717:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.290747:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.290752:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.290758:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.290764:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802325.290784:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.290791:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.290802:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:1.0:1788802325.290805:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788802325.290809:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.290815:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802325.290883:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:11491:x1875694872241024:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 738us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802325.290891:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 165 00000100:00100000:0.0:1788802325.295851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802325.295937:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802325.296016:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872241408 00000100:00100000:1.0:1788802325.296026:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872241408 00000100:00100000:1.0:1788802325.296094:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788802325.296106:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:2357:x1875694872241408:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802325.296122:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802325.296149:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9c8e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeee7 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.296168:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:1.0:1788802325.296174:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802325.296429:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:2357:x1875694872241408:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 324us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802325.296464:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788802325.296735:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872241280 00000100:00100000:2.0:1788802325.296741:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872241280 00000100:00100000:2.0:1788802325.296813:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:2.0:1788802325.296822:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:11491:x1875694872241280:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788802325.297027:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:11491:x1875694872241280:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 206us (1185us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788802325.297034:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:0.0:1788802325.470867:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802325.471028:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872241664 00000100:00100000:1.0:1788802325.471038:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872241664 00000100:00100000:1.0:1788802325.471148:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 166 00000100:00100000:1.0:1788802325.471159:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:11509:x1875694872241664:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:1.0:1788802325.471183:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802325.471202:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeeee expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.471586:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c900 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.471603:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.471615:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802325.471627:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788802325.471758:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9c8f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeee expref: 32 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.471779:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c900 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeee expref: 31 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802325.471788:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:1.0:1788802325.471792:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788802325.471795:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2800, rc 0) 00000100:00100000:1.0:1788802325.471883:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11509:x1875694872241664:12345-192.168.201.57@tcp:101:cat.0 Request processed in 708us (1010us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788802325.471890:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 166 00000100:00100000:0.0:1788802325.506565:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802325.506715:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872241792 00000100:00100000:2.0:1788802325.506726:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872241792 00000100:00100000:2.0:1788802325.506800:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 167 00000100:00100000:2.0:1788802325.506811:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11510:x1875694872241792:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802325.506835:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802325.506856:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c90e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeef5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.506938:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c915 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.506952:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.506963:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802325.507016:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788802325.507020:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802325.507036:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.507065:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c90e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeef5 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.507086:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c915 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeef5 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.507095:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:2.0:1788802325.507099:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802325.507102:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216f400, rc 0) 00000100:00100000:2.0:1788802325.507165:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11510:x1875694872241792:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 356us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802325.507173:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 167 00000100:00100000:0.0:1788802325.515713:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802325.515870:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872242176 00000100:00100000:3.0:1788802325.515882:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872242176 00000100:00100000:3.0:1788802325.515948:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:3.0:1788802325.515960:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11510:x1875694872242176:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802325.516373:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:11510:x1875694872242176:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 403us (658us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788802325.516381:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:0.0:1788802325.522098:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802325.522433:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872242304 00000100:00100000:2.0:1788802325.522695:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872242304 00000100:00100000:2.0:1788802325.522817:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:2.0:1788802325.522830:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:11510:x1875694872242304:12345-192.168.201.57@tcp:103:lfs.0 00010000:00010000:2.0:1788802325.522856:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788802325.522887:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c8a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeed9 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.522912:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9c900 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeeee expref: 32 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.522943:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95ec00/0x6ecba1490fc9c7a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee9a expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.522954:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d2166ac00) 00010000:00010000:2.0:1788802325.522965:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802325.523039:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:11510:x1875694872242304:12345-192.168.201.57@tcp:103:lfs.0 Request processed in 211us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802325.523046:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:1.0:1788802325.526449:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802325.526547:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872242432 00000100:00100000:3.0:1788802325.526561:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872242432 00000100:00100000:3.0:1788802325.526637:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 168 00000100:00100000:3.0:1788802325.526648:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:11510:x1875694872242432:12345-192.168.201.57@tcp:58:lfs.0 00010000:00010000:3.0:1788802325.526789:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c91c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802325.526809:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c91c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802325.526843:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c91c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788802325.528774:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788802325.528910:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:11510:x1875694872242432:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 2258us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802325.528921:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 168 00000100:00100000:3.0:1788802325.559615:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802325.567137:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872242560 00000100:00100000:2.0:1788802325.567157:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872242560 00000100:00100000:2.0:1788802325.567254:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 169 00000100:00100000:2.0:1788802325.567266:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+30:11512:x1875694872242560:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802325.567296:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802325.567318:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c923 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeefc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.567398:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c92a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.567412:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c92a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.567423:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c92a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.567437:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c931 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.567478:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.567485:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.567771:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.567780:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.567787:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802325.567823:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788802325.567828:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802325.569028:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569058:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569069:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c92a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569075:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c92a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569081:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c92a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569104:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802325.569108:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c92a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569115:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c92a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569128:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:2.0:1788802325.569131:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802325.569136:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c92a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569143:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c92a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569160:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569166:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c931 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569171:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569176:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216e000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802325.569178:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569184:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c931 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569203:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d013ef300) 00010000:00010000:2.0:1788802325.569208:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802325.569212:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c931 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569218:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c931 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569309:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c923 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeefc expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569326:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeefc expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802325.569332:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802325.569334:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802325.569337:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216f200, rc 0) 00000100:00100000:2.0:1788802325.569446:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11512:x1875694872242560:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 2173us (9833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802325.569455:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 169 00010000:00010000:0.0:1788802325.580548:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802325.900617:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892166016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802325.900702:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802325.900890:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892166016 00000100:00100000:0.0:1788802325.900900:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892166016 00000100:00100000:0.0:1788802325.900964:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788802325.900976:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875694892166016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802325.901010:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802325.901074:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875694892166016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802325.901081:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788802325.901119:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788802325.901125:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788802325.901151:0:3312:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff910d41db4e00 x1875694892165504/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788802340 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802325.901192:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892166016:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788802325.901775:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788802326.009188:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802326.009424:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802326.009558:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802326.009601:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872242688 00000100:00100000:3.0:1788802326.009613:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872242688 00000100:00100000:3.0:1788802326.009671:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 298 00000100:00100000:3.0:1788802326.009682:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872242688:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802326.009752:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f34e9515-dc55-4812-97ce-617e4dd802db+13:2360:x1875694872242688:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 71us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802326.009759:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 298 00000100:00100000:1.0:1788802326.013876:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802326.013911:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872243072 00000100:00100000:1.0:1788802326.013920:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872243072 00000100:00100000:1.0:1788802326.013993:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 157 00000100:00100000:1.0:1788802326.014004:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872243072:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802326.014089:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2360:x1875694872243072:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802326.014097:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 157 00000100:00080000:1.0:1788802326.014288:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802326.014686:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872242944 00000100:00100000:2.0:1788802326.014694:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872242944 00000100:00100000:2.0:1788802326.014743:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872242816 00000100:00100000:2.0:1788802326.014746:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872242816 00000100:00100000:2.0:1788802326.014771:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:2.0:1788802326.014790:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872242944:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802326.014835:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872242944:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 48us (5412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802326.014842:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:2.0:1788802326.014857:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:2.0:1788802326.014863:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872242816:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802326.014891:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872242816:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 29us (5334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802326.014896:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00080000:1.0:1788802326.014961:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788802326.014965:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788802326.542952:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802326.542962:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802326.543002:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788802326.543008:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788802326.543145:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33d9c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892166144:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788802326.544802:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b5bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788802326.566050:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33d9c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892166144:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788802326.568704:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802326.568746:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872243200 00000100:00100000:3.0:1788802326.568757:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872243200 00000100:00100000:3.0:1788802326.568822:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 170 00000100:00100000:3.0:1788802326.568833:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11523:x1875694872243200:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788802326.568877:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788802326.568983:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11523:x1875694872243200:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 151us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802326.568991:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 170 00000100:00080000:3.0:1788802326.569013:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802326.591477:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802326.591943:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872243328 00000100:00100000:1.0:1788802326.591954:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872243328 00000100:00100000:1.0:1788802326.592018:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 171 00000100:00100000:1.0:1788802326.592030:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11523:x1875694872243328:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788802326.592112:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c93f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592131:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c93f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592156:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c93f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592172:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c946 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592179:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c946 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592185:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c946 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592211:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592219:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592226:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802326.592308:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788802326.592313:0:9415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802326.592326:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592336:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c93f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592352:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c93f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592369:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c93f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592375:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802326.592380:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c93f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592389:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c93f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592403:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:1.0:1788802326.592406:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802326.592411:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c93f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592417:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9c93f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592431:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c946 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592437:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c946 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592442:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c946 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592446:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802326.592449:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c946 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592464:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c946 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592472:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff910d05184100) 00010000:00010000:1.0:1788802326.592474:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802326.592477:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c946 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592483:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9c946 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592498:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592505:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592510:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592514:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802326.592517:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592522:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592527:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21600) 00010000:00010000:1.0:1788802326.592530:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802326.592533:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.592546:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c94d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802326.592620:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11523:x1875694872243328:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 592us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802326.592628:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 171 00000040:00080000:3.0:1788802326.597157:0:12400:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802326.597167:0:12400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802326.597210:0:12400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788802326.597216:0:12400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788802326.601383:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802326.601519:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872243584 00000100:00100000:3.0:1788802326.601530:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872243584 00000100:00100000:3.0:1788802326.601594:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 172 00000100:00100000:3.0:1788802326.601605:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11523:x1875694872243584:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788802326.601627:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802326.601648:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c954 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef03 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.601749:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c95b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.601766:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.601778:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802326.601790:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788802326.601885:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.601904:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c95b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.601911:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c95b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.601916:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802326.601920:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c95b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.601927:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c95b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.601941:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21600) 00010000:00010000:3.0:1788802326.601944:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788802326.601948:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c95b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.601953:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c95b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.601990:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c954 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef03 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.602000:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:3.0:1788802326.602002:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788802326.602006:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c954 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef03 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.602014:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9200, rc 0) 00000100:00100000:3.0:1788802326.602085:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11523:x1875694872243584:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 483us (714us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788802326.602092:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 172 00010000:00010000:1.0:1788802326.605855:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802326.606629:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802326.606701:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872243712 00000100:00100000:2.0:1788802326.606712:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872243712 00000100:00100000:2.0:1788802326.606768:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 173 00000100:00100000:2.0:1788802326.606779:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11523:x1875694872243712:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788802326.606815:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788802326.606932:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11523:x1875694872243712:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 153us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802326.606940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 173 00000100:00100000:1.0:1788802326.615690:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802326.629114:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872243968 00000100:00100000:0.0:1788802326.629129:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872243968 00000100:00100000:0.0:1788802326.629206:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 174 00000100:00100000:0.0:1788802326.629216:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11523:x1875694872243968:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802326.629268:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802326.629272:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788802326.629300:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c915 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeef5 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.629318:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802326.629324:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788802326.629338:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c969 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef0a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788802326.630048:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788802326.630322:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c970 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.630337:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.630360:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.630417:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c969 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef0a expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.630442:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c970 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef0a expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.630450:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8f00) 00010000:00010000:0.0:1788802326.630454:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802326.630456:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1400, rc 0) 00000100:00100000:0.0:1788802326.630524:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:11523:x1875694872243968:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1309us (14842us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788802326.630533:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 174 00000100:00100000:3.0:1788802326.638774:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802326.638859:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872244224 00000100:00100000:2.0:1788802326.638871:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872244224 00000100:00100000:2.0:1788802326.638939:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 175 00000100:00100000:2.0:1788802326.638950:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:11523:x1875694872244224:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788802326.639007:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802326.639033:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9c970 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef0a expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639067:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8f00) 00010000:00010000:2.0:1788802326.639079:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802326.639104:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c97e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639118:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c97e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639129:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c97e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639190:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9c985 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9a3701da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639199:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9c985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a3701da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639206:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9c985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a3701da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639458:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c97e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639466:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c97e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639473:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c97e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639478:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802326.639483:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c97e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639498:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c97e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639507:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:2.0:1788802326.639510:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802326.639514:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c97e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639520:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f800/0x6ecba1490fc9c97e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639531:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9c985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a3701da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639537:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9c985 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a3701da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639542:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9c985 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a3701da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639546:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216fa00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802326.639548:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9c985 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a3701da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639554:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9c985 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a3701da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639560:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9a3701da (ffff910d013ef300) 00010000:00010000:2.0:1788802326.639563:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802326.639565:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9c985 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9a3701da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.639582:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9c985 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9a3701da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802326.639664:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11523:x1875694872244224:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 715us (901us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788802326.639673:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 175 00000100:00100000:1.0:1788802326.651899:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802326.652736:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872244352 00000100:00100000:0.0:1788802326.652749:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872244352 00000100:00100000:0.0:1788802326.652805:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 176 00000100:00100000:0.0:1788802326.652816:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11523:x1875694872244352:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802326.652836:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802326.652860:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c98c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef11 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.652895:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.652909:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.652921:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.653019:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c98c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef11 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.653042:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef11 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.653051:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8400) 00010000:00010000:0.0:1788802326.653054:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788802326.653058:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1c00, rc 0) 00000100:00100000:0.0:1788802326.653115:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:11523:x1875694872244352:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 301us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802326.653122:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 176 00000100:00100000:2.0:1788802326.664625:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802326.664803:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872244608 00000100:00100000:1.0:1788802326.664814:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872244608 00000100:00100000:1.0:1788802326.664878:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 177 00000100:00100000:1.0:1788802326.664890:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+33:11523:x1875694872244608:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788802326.664986:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.665004:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.665016:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788802326.665376:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788802326.665388:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379612149152ns, next at 380612146467ns, rc = 0 00000004:00010000:1.0:1788802326.665477:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0b898ae reply state 00000000f19960d8 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802326.665503:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788802326.665604:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:11523:x1875694872244608:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 715us (988us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788802326.665612:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 177 00010000:00010000:3.0:1788802326.677908:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802326.677908:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:3.0:1788802326.677927:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.677935:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.677942:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802326.677948:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.677955:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.677972:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8400) 00010000:00010000:3.0:1788802326.677976:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788802326.677981:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.677987:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9c99a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802326.678415:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872244736 00000100:00100000:0.0:1788802326.678426:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872244736 00000100:00100000:0.0:1788802326.678482:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 178 00000100:00100000:0.0:1788802326.678492:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:11523:x1875694872244736:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802326.678515:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802326.678533:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c9a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef18 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.678588:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef18 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.678603:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef18 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.678622:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8400) 00010000:00010000:0.0:1788802326.678625:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788802326.678642:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1a00, rc 0) 00000100:00100000:0.0:1788802326.678720:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:11523:x1875694872244736:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 229us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802326.678728:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 178 00000100:00100000:1.0:1788802326.683398:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802326.683446:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872244864 00000100:00100000:3.0:1788802326.683457:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872244864 00000100:00100000:3.0:1788802326.683524:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:3.0:1788802326.683535:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872244864:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788802326.683932:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872244864:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 398us (555us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788802326.683940:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:0.0:1788802326.688394:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802326.688440:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872245120 00000100:00100000:3.0:1788802326.688453:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872245120 00000100:00100000:3.0:1788802326.688540:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:3.0:1788802326.688552:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:11523:x1875694872245120:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788802326.688829:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:11523:x1875694872245120:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 279us (444us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788802326.688837:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:1.0:1788802326.692912:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802326.693037:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872245376 00000100:00100000:3.0:1788802326.693048:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872245376 00000100:00100000:3.0:1788802326.693106:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 179 00000100:00100000:3.0:1788802326.693116:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:11523:x1875694872245376:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788802326.693219:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:11523:x1875694872245376:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 104us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802326.693263:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 179 00000100:00100000:3.0:1788802326.695622:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802326.695663:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872245504 00000100:00100000:3.0:1788802326.695685:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872245504 00000100:00100000:3.0:1788802326.696368:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 180 00000100:00100000:3.0:1788802326.696386:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:11523:x1875694872245504:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788802326.696410:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802326.696431:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c9a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.696826:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c9af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.696843:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.696857:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802326.696905:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802326.696928:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.696957:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c9a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef1f expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.696973:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef1f expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.696983:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8400) 00010000:00010000:3.0:1788802326.696986:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788802326.696990:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9e00, rc 0) 00000100:00100000:3.0:1788802326.697061:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:11523:x1875694872245504:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 680us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802326.697070:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 180 00000100:00100000:1.0:1788802326.700708:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802326.700784:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872245632 00000100:00100000:2.0:1788802326.700796:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872245632 00000100:00100000:2.0:1788802326.700858:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:2.0:1788802326.700869:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872245632:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802326.700887:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802326.700907:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2da51d2/0x6ecba1490fc9c9b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef26 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788802326.701003:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ef516, blocks: 0x1 00010000:00010000:2.0:1788802326.701021:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1788802326.701026:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802326.701034:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2da51d2/0x6ecba1490fc9c9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef26 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.701051:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2da51d2/0x6ecba1490fc9c9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef26 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.701065:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216fa00, rc 0) 00000100:00100000:2.0:1788802326.701132:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2360:x1875694872245632:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 265us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802326.701138:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:1.0:1788802326.707930:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802326.708010:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872245888 00000100:00100000:2.0:1788802326.708022:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872245888 00000100:00100000:2.0:1788802326.708077:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 181 00000100:00100000:2.0:1788802326.708089:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:11523:x1875694872245888:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788802326.708216:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:11523:x1875694872245888:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 130us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802326.708224:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 181 00000100:00100000:3.0:1788802326.720585:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802326.720684:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872246016 00000100:00100000:0.0:1788802326.720695:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872246016 00000100:00100000:0.0:1788802326.720754:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:0.0:1788802326.720765:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:11523:x1875694872246016:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802326.720784:0:8127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802326.720803:0:8127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef2d expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.720835:0:8127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2da51d2/0x6ecba1490fc9c9b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef26 expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.720844:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802326.720848:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802326.720853:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 9 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.720890:0:8127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2da51d2/0x6ecba1490fc9c9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef26 expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.720904:0:8127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2da51d2/0x6ecba1490fc9c9b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef26 expref: 9 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802326.720936:0:8127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8127:1875694892166272:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802326.721033:0:8127:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1036fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788802326.723658:0:8127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8127:1875694892166272:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802326.723696:0:8127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 9 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.723718:0:8127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1400, rc 0) 00000100:00100000:0.0:1788802326.723851:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802326.723993:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:11523:x1875694872246016:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 3228us (3418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802326.724003:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:0.0:1788802326.724110:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872246144 00000100:00100000:0.0:1788802326.724120:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872246144 00010000:00010000:0.0:1788802326.724166:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2da51d2/0x6ecba1490fc9c9b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef26 expref: 10 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802326.724208:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00100000:0.0:1788802326.724218:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:2359:x1875694872246144:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788802326.724231:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802326.724282:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2da51d2/0x6ecba1490fc9c9b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef26 expref: 10 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.724294:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2da51d2/0x6ecba1490fc9c9b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef26 expref: 10 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.724316:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2da51d2/0x6ecba1490fc9c9b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef26 expref: 10 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.724329:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802326.724333:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802326.724349:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 9 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.724372:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 9 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.724410:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802326.724424:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1875694892166400:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788802326.724510:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1036fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788802326.735754:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802326.735814:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872246272 00000100:00100000:2.0:1788802326.735826:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872246272 00002000:00100000:2.0:1788802326.735876:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff910d41e6df80 x1875694872246272/t0(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:467/0 lens 504/0 e 0 to 0 dl 1788802337 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788802326.735887:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d41e6df80 with x1875694872246272 ext(0->8) 00002000:00010000:2.0:1788802326.735895:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d41e6df80 00000100:00100000:2.0:1788802326.735971:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788802326.735991:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2360:x1875694872246272:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788802326.736561:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:2360:x1875694872246272:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 Request processed in 569us (812us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788802326.736570:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00002000:00100000:2.0:1788802326.736579:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff910d41e6df80 x1875694872246272/t4294967314(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:467/0 lens 504/448 e 0 to 0 dl 1788802337 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788802326.736588:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d41e6df80 with x1875694872246272 ext(0->8) 00002000:00010000:2.0:1788802326.736592:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d41e6df80 00000100:00100000:1.0:1788802326.738807:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1875694892166400:192.168.201.57@tcp:105: 00010000:00010000:1.0:1788802326.738837:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802326.738902:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:2359:x1875694872246144:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 14684us (15051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802326.738915:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00100000:3.0:1788802326.741383:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802326.741576:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872246400 00000100:00100000:1.0:1788802326.741589:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872246400 00000100:00100000:1.0:1788802326.741649:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 182 00000100:00100000:1.0:1788802326.741661:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:11523:x1875694872246400:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788802326.834940:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:2.0:1788802326.835100:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788802326.835107:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:1.0:1788802326.835410:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788802326.835431:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892166528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788802326.835512:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802326.835597:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892166528 00000100:00100000:1.0:1788802326.835605:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892166528 00000100:00100000:1.0:1788802326.835660:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788802326.835681:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892166528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788802326.836004:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788802326.836008:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788802326 00002000:00010000:1.0:1788802326.836011:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788802326.836012:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788802326 -> 1788802326 00002000:00010000:1.0:1788802326.836014:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788802326.836060:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875694892166528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 392us (548us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788802326.836068:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788802326.836092:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788802326.836123:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d3fad4e00/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788802326.836130:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892166528:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1788802326.836478:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1788802326.836493:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1788802326.836794:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788802326.836809:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788802326.837019:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:11523:x1875694872246400:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 95356us (95642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802326.837030:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 182 00000100:00100000:2.0:1788802326.847905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802326.848100:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872246528 00000100:00100000:3.0:1788802326.848112:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872246528 00000100:00100000:3.0:1788802326.848176:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:3.0:1788802326.848187:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:2359:x1875694872246528:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788802326.883461:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1788802326.883482:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1788802326.883861:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872246528:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 35671us (35959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802326.883873:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:2.0:1788802326.888193:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802326.888440:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872246784 00000100:00100000:3.0:1788802326.888452:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872246784 00000100:00100000:3.0:1788802326.888524:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 183 00000100:00100000:3.0:1788802326.888535:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:11523:x1875694872246784:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788802326.888593:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802326.888620:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c9af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef1f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.888642:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8400) 00010000:00010000:3.0:1788802326.888648:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802326.888921:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.888938:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802326.888950:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802326.892684:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea730eb8 reply state 00000000cab8faf2 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802326.892711:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788802326.892849:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:11523:x1875694872246784:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 4312us (4664us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788802326.892875:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 183 00010000:00010000:2.0:1788802326.896558:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.896579:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.896587:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.896594:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802326.896599:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.896627:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.896644:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8400) 00010000:00010000:2.0:1788802326.896647:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802326.896653:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.896660:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9c9c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802326.898006:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802326.898129:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872246912 00000100:00100000:1.0:1788802326.898217:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872246912 00000100:00100000:1.0:1788802326.898522:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:1.0:1788802326.898535:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872246912:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788802326.898839:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788802326.898843:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788802326 -> 1788802325 00002000:00010000:1.0:1788802326.898846:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788802323 00002000:00010000:1.0:1788802326.898848:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788802326 -> 1788802325 00002000:00010000:1.0:1788802326.898850:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788802326.898920:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872246912:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 387us (1221us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788802326.898944:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:3.0:1788802326.902159:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802326.902352:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872247168 00000100:00100000:1.0:1788802326.902363:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872247168 00000100:00100000:1.0:1788802326.902430:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 184 00000100:00100000:1.0:1788802326.902441:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:11523:x1875694872247168:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788802326.902530:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.902548:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef11 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.902557:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.902595:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef11 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.902610:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef11 expref: 18 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802326.902627:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892166656:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802326.902815:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d358d09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802326.913204:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892166656:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802326.913438:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802326.927686:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802326.933820:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872247296 00000100:00100000:0.0:1788802326.933836:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872247296 00010000:00010000:2.0:1788802326.934404:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef11 expref: 19 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802326.934463:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:2.0:1788802326.934474:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:2359:x1875694872247296:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802326.934494:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802326.934502:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef11 expref: 19 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.934518:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef11 expref: 19 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.934545:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c993 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef11 expref: 19 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.934564:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8400) 00010000:00010000:2.0:1788802326.934584:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.934594:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.934602:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.934639:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788802326.934910:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.934921:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.934950:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.934957:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.934970:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.934977:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802326.934981:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.934988:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.934998:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8400) 00010000:00010000:0.0:1788802326.935000:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788802326.935004:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.935011:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9c9cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802326.935122:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:11523:x1875694872247168:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 Request processed in 32681us (32972us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788802326.935141:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 184 00000100:00100000:2.0:1788802326.938719:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:2359:x1875694872247296:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 4235us (11041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802326.938734:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:0.0:1788802326.949864:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802326.951460:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872247424 00000100:00100000:2.0:1788802326.951489:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872247424 00000100:00100000:2.0:1788802326.951567:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:2.0:1788802326.951579:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2360:x1875694872247424:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788802326.951625:0:8127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.951646:0:8127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.951655:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802326.951659:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788802326.951664:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.951902:0:8127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.951935:0:8127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 8 pid: 8127 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802326.951952:0:8127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8127:1875694892166784:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802326.952056:0:8127:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d03caf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802326.959654:0:8127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8127:1875694892166784:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802326.959699:0:8127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802326.966071:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802326.966195:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872247552 00000100:00100000:1.0:1788802326.966219:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872247552 00010000:00010000:1.0:1788802326.966304:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 9 pid: 8127 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802326.966356:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:1.0:1788802326.966367:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08318050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2359:x1875694872247552:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802326.966384:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802326.966415:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 9 pid: 8127 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.966431:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 9 pid: 8127 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.966461:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000900e6786/0x6ecba1490fc9c9bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef2d expref: 9 pid: 8127 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.966492:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802326.966497:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802326.966505:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.966515:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.966551:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802326.966616:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08318050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872247552:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 250us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802326.966636:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 68 00010000:00010000:2.0:1788802326.967014:0:8127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.967024:0:8127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.967052:0:8127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.967061:0:8127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.967069:0:8127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.967088:0:8127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802326.967093:0:8127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.967101:0:8127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.967113:0:8127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.967120:0:8127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9c9d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802326.967174:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872247424:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 15596us (17319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802326.967193:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:3.0:1788802326.972810:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802326.972951:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872247808 00000100:00100000:2.0:1788802326.972961:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872247808 00000100:00100000:2.0:1788802326.973014:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 185 00000100:00100000:2.0:1788802326.973024:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+17:11523:x1875694872247808:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788802326.973101:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c9d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.973117:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.974023:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.974374:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.974395:0:9415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c9a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef18 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.974404:0:9415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.974456:0:9415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef18 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.974950:0:9415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef18 expref: 18 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802326.974970:0:9415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee63480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9415:1875694892166912:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802326.975074:0:9415:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d03caf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802326.978326:0:9415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee63480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9415:1875694892166912:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802326.978370:0:9415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802326.985550:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802326.985872:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872247936 00000100:00100000:2.0:1788802326.985883:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872247936 00010000:00010000:2.0:1788802326.985927:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef18 expref: 19 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802326.985994:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:2.0:1788802326.986005:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:2360:x1875694872247936:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802326.986020:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802326.986027:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef18 expref: 19 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.986040:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef18 expref: 19 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.986062:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9c9a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef18 expref: 19 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.986079:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8400) 00010000:00010000:2.0:1788802326.986085:0:7624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.986094:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.986101:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.986147:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802326.986210:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:2360:x1875694872247936:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 206us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802326.986218:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 69 00010000:00010000:0.0:1788802326.986513:0:9415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802326.986523:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802326.986731:0:9415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788802326.986897:0:9415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788802326.986941:0:9415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788802326.987025:0:9415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9415:1875694892167040:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788802326.987081:0:9415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802326.987123:0:9415:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802326.987341:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892167040 00000100:00100000:1.0:1788802326.987348:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892167040 00000100:00100000:1.0:1788802326.987390:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788802326.987399:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9415:x1875694892167040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788802326.987476:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9415:x1875694892167040:12345-0@lo:1000:mdt00_003.0 Request processed in 78us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802326.987483:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788802326.987790:0:9415:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788802326.987804:0:9415:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d3fad4e00, transno 4294967315 00000100:00100000:2.0:1788802326.987863:0:9415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9415:1875694892167040:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788802326.988404:0:9415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788802326.988488:0:9415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee63480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9415:1875694892167168:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788802326.988535:0:9415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802326.988561:0:9415:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d216cfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802326.988582:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892167168 00000100:00100000:2.0:1788802326.988588:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892167168 00000100:00100000:2.0:1788802326.988626:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788802326.988634:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9415:x1875694892167168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788802326.988816:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9415:x1875694892167168:12345-0@lo:1000:mdt00_003.0 Request processed in 182us (281us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788802326.988823:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788802326.988860:0:9415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee63480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9415:1875694892167168:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788802326.988895:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.988905:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.988913:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.988919:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216ec00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802326.988923:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.988930:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.988953:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8400) 00010000:00010000:2.0:1788802326.988956:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788802326.988962:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.988968:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9c9e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989000:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c91c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989007:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c91c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989013:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c91c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989018:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802326.989021:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c91c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989026:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c91c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989034:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802326.989036:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788802326.989039:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c91c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989045:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9c91c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989078:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989093:0:9415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeefc expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989102:0:9415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989127:0:9415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeefc expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.989141:0:9415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeefc expref: 21 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802326.989151:0:9415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee62680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9415:1875694892167296:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802326.989209:0:9415:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d167b0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788802326.993966:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802326.994858:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872248064 00000100:00100000:0.0:1788802326.994871:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872248064 00010000:00010000:0.0:1788802326.994911:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeefc expref: 22 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802326.994980:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:2.0:1788802326.995062:0:9415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee62680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9415:1875694892167296:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802326.995071:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:2359:x1875694872248064:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802326.995091:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802326.995093:0:9415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.995102:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeefc expref: 22 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.995116:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeefc expref: 22 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.995141:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f200/0x6ecba1490fc9c938 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeefc expref: 22 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.995296:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21600) 00010000:00010000:1.0:1788802326.995303:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.995314:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.995344:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802326.995374:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802326.995446:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:2359:x1875694872248064:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 455us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802326.995454:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 70 00010000:00010000:2.0:1788802326.995900:0:9415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.995910:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.995924:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.995940:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.995947:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.995952:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802326.995957:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.995965:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.995976:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802326.995979:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802326.995982:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.995988:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9c9e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.996000:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.996006:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c9d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.996012:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.996018:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216e000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802326.996027:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.996033:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c9d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.996041:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21600) 00010000:00010000:2.0:1788802326.996044:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788802326.996047:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c9d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802326.996053:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9c9d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802326.996302:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:11523:x1875694872247808:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 23276us (23497us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788802326.996312:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 185 00000020:00080000:2.0:1788802326.996318:0:9415:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788802326.996949:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802326.996954:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802326.997984:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788802326.997998:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788802327.003475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802327.003608:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872248320 00000100:00100000:0.0:1788802327.003619:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872248320 00000100:00100000:0.0:1788802327.003846:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:0.0:1788802327.003859:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:11523:x1875694872248320:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788802327.004642:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788802327.004757:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788802327.004807:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802327.004824:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802327.004838:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802327.004846:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802327.004851:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802327.004870:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802327.004901:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788802327.005016:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:11523:x1875694872248320:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 1156us (1549us total) trans 4294967468 rc 0/0 00010000:00010000:2.0:1788802327.005072:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802327.005082:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802327.005091:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802327.005096:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802327.005106:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802327.005122:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff910d02db8800) 00010000:00010000:2.0:1788802327.005126:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788802327.005140:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802327.005146:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9c9ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802327.005167:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802327.005169:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802327.005170:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802327.006124:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00000020:00080000:0.0:1788802327.006210:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788802327.629034:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788802328.014684:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802328.014698:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802328.014902:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788802328.014909:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788802328.454774:0:12454:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788802328.454784:0:12454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788802328.454832:0:12454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788802328.454838:0:12454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788802328.461106:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892167424:0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461176:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802328.461219:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892167936:0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461399:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802328.461425:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788802328.461430:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892167808:0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461453:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802328.461480:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892167552:0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461501:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802328.461513:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892168064:0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461532:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802328.461547:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788802328.461551:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892167680:0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461567:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802328.461599:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892167808 00000100:00100000:1.0:1788802328.461606:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892167808 00000100:00100000:1.0:1788802328.461653:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892168064 00000100:00100000:1.0:1788802328.461656:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892168064 00000100:00100000:1.0:1788802328.461675:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788802328.461683:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875694892167808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461729:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875694892167808:12345-0@lo:400:kworker.0 Request processed in 46us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802328.461736:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788802328.461753:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788802328.461759:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892168064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461797:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892168064:12345-0@lo:400:kworker.0 Request processed in 38us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802328.461803:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788802328.461820:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892167936 00000100:00100000:1.0:1788802328.461824:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892167936 00000100:00100000:1.0:1788802328.461846:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892167552 00000100:00100000:1.0:1788802328.461848:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892167552 00000100:00100000:1.0:1788802328.461858:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892167680 00000100:00100000:1.0:1788802328.461860:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892167680 00000100:00100000:2.0:1788802328.461865:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892168064:0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461871:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788802328.461876:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892167936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802328.461891:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788802328.461897:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892167552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461904:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892167936:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802328.461910:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788802328.461921:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788802328.461927:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892167680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802328.461929:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892167552:12345-0@lo:400:kworker.0 Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802328.461934:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788802328.461949:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892167680:12345-0@lo:400:kworker.0 Request processed in 23us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802328.461958:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892167680:0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.461961:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788802328.461966:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892167552:0@lo:400:kworker.0 00000100:00080000:1.0:1788802328.461976:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788802328.461981:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788802328.461983:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788802328.462004:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892167808:0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.462013:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892167936:0@lo:400:kworker.0 00000100:00100000:0.0:1788802328.462298:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892167424 00000100:00100000:0.0:1788802328.462303:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892167424 00000100:00100000:0.0:1788802328.462345:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788802328.462352:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892167424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802328.462406:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3314:x1875694892167424:12345-0@lo:400:kworker.0 Request processed in 55us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802328.462412:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788802328.463748:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892167424:0@lo:400:kworker.0 00000100:00100000:1.0:1788802328.610013:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802328.610074:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872248576 00000100:00100000:3.0:1788802328.610082:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872248576 00000100:00100000:3.0:1788802328.610146:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 186 00000100:00100000:3.0:1788802328.610155:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:11543:x1875694872248576:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802328.610178:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802328.610196:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c9f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef34 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.610322:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c9fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.610337:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c9fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.610359:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c9fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802328.610371:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788802328.610484:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9c9f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef34 expref: 25 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.610501:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c9fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef34 expref: 24 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.610522:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:3.0:1788802328.610525:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788802328.610529:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9200, rc 0) 00000100:00100000:3.0:1788802328.610587:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:11543:x1875694872248576:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 432us (583us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788802328.610594:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 186 00000100:00080000:1.0:1788802328.610994:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802328.615424:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802328.615688:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872248704 00000100:00100000:2.0:1788802328.615701:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872248704 00000100:00100000:2.0:1788802328.615794:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 187 00000100:00100000:2.0:1788802328.615805:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:11543:x1875694872248704:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:2.0:1788802328.615892:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.615911:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.615924:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.615951:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.615958:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.615964:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616202:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616211:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616218:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802328.616346:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616361:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616368:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616374:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616380:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216ea00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802328.616384:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616398:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616410:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:2.0:1788802328.616413:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802328.616418:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616424:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616435:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616441:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616446:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616450:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216ec00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802328.616453:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616459:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616466:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d013ef300) 00010000:00010000:2.0:1788802328.616469:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802328.616471:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616488:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616504:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616510:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616515:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616519:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802328.616521:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616526:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616532:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d013eff00) 00010000:00010000:2.0:1788802328.616534:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802328.616537:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.616542:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802328.616636:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:11543:x1875694872248704:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 830us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802328.616644:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 187 00010000:00010000:1.0:1788802328.652482:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802328.676216:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802328.677015:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872248960 00000100:00100000:2.0:1788802328.677028:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872248960 00000100:00100000:3.0:1788802328.677350:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 188 00000100:00100000:3.0:1788802328.677362:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+24:11546:x1875694872248960:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802328.677389:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802328.677412:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9ca1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef3b expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677492:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9ca26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677518:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9ca26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677547:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9ca26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677573:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9ca2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677582:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9ca2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677589:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9ca2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677852:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677861:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677869:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802328.677878:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788802328.677969:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9ca26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677977:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9ca26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677984:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9ca26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.677989:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802328.677999:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9ca26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678007:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9ca26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678018:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:3.0:1788802328.678021:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802328.678026:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9ca26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678033:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9ca26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678046:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9ca2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678052:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9ca2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678058:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9ca2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678062:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802328.678065:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9ca2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678071:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9ca2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678078:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02e21500) 00010000:00010000:3.0:1788802328.678081:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802328.678090:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9ca2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678096:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9ca2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678142:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9ca1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef3b expref: 27 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678156:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef3b expref: 26 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.678162:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:3.0:1788802328.678164:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788802328.678167:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8a00, rc 0) 00000100:00100000:3.0:1788802328.679136:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11546:x1875694872248960:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1770us (2925us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788802328.679147:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 188 00000100:00100000:1.0:1788802328.687567:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802328.688132:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872249088 00000100:00100000:0.0:1788802328.688144:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872249088 00000100:00100000:0.0:1788802328.688223:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 189 00000100:00100000:0.0:1788802328.688268:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11546:x1875694872249088:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:0.0:1788802328.688364:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.688382:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.688520:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.688566:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.688573:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.688592:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.688599:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802328.688604:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.688612:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.688624:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:0.0:1788802328.688627:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788802328.688632:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.688639:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802328.688722:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11546:x1875694872249088:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 491us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802328.688730:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 189 00000100:00100000:1.0:1788802328.692610:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802328.692752:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872249344 00000100:00100000:3.0:1788802328.692762:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872249344 00000100:00100000:3.0:1788802328.692812:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:3.0:1788802328.692821:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11546:x1875694872249344:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802328.693036:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:11546:x1875694872249344:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 216us (434us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788802328.693043:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:3.0:1788802328.728088:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802328.728283:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872249600 00000100:00100000:0.0:1788802328.728314:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872249600 00000100:00100000:0.0:1788802328.728389:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 190 00000100:00100000:0.0:1788802328.728432:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:11071:x1875694872249600:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802328.728465:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802328.728489:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef42 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.728611:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.728628:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef3b expref: 28 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.728637:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.728671:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef3b expref: 28 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.728685:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef3b expref: 28 pid: 9415 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802328.728701:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892168192:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802328.729076:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72000 going to sleep for 11 seconds 00000100:00100000:1.0:1788802328.733780:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802328.734027:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892168192:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802328.734057:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802328.737635:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872249728 00000100:00100000:2.0:1788802328.737653:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872249728 00010000:00010000:2.0:1788802328.737709:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef3b expref: 29 pid: 9415 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802328.737762:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 71 00000100:00100000:2.0:1788802328.737773:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:2359:x1875694872249728:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802328.737790:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802328.737797:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef3b expref: 29 pid: 9415 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.737810:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef3b expref: 29 pid: 9415 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.737832:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8a00/0x6ecba1490fc9ca34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef3b expref: 29 pid: 9415 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.737852:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:2.0:1788802328.737869:0:7624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.737878:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.737885:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.737919:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802328.738002:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:2359:x1875694872249728:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 230us (4231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802328.738009:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 71 00010000:00010000:0.0:1788802328.738565:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.738587:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802328.738607:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788802328.738755:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ca49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef42 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.738772:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef42 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.738781:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:0.0:1788802328.738785:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788802328.738788:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0a00, rc 0) 00000100:00100000:0.0:1788802328.738824:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:11071:x1875694872249600:12345-192.168.201.57@tcp:101:bash.0 Request processed in 10397us (10754us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788802328.738833:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 190 00000100:00100000:1.0:1788802328.743367:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802328.743776:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872249984 00000100:00100000:0.0:1788802328.743793:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872249984 00000100:00100000:0.0:1788802328.743871:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 191 00000100:00100000:0.0:1788802328.743881:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:11071:x1875694872249984:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:0.0:1788802328.744150:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.744168:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.744181:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802328.744309:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788802328.744336:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d32e813a reply state 00000000f7d8e1a3 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802328.744345:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788802328.744389:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788802328.744504:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11071:x1875694872249984:12345-192.168.201.57@tcp:36:bash.0 Request processed in 624us (1154us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788802328.744512:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 191 00000020:00080000:0.0:1788802328.744520:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788802328.746131:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.746157:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.746165:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.746173:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802328.746179:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.746189:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.746213:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:2.0:1788802328.746217:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802328.746224:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.746231:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9ca5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802328.746971:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802328.747059:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872250112 00000100:00100000:3.0:1788802328.747072:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872250112 00000100:00100000:3.0:1788802328.747164:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 192 00000100:00100000:3.0:1788802328.747176:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11071:x1875694872250112:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788802328.747205:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802328.747228:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9ca65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef49 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.747363:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9ca65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef49 expref: 32 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.747381:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9ca65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef49 expref: 32 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802328.747405:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:3.0:1788802328.747409:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788802328.747412:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9e00, rc 0) 00000100:00100000:3.0:1788802328.747491:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11071:x1875694872250112:12345-192.168.201.57@tcp:101:bash.0 Request processed in 317us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802328.747500:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 192 00000100:00100000:3.0:1788802328.751453:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802328.751654:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872250240 00000100:00100000:1.0:1788802328.751668:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872250240 00000100:00100000:1.0:1788802328.751847:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:1.0:1788802328.751860:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:11071:x1875694872250240:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788802328.751887:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802328.751915:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f630ccd6/0x6ecba1490fc9ca6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef50 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788802328.751949:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ef515, atime: 0x6a9ef513, ctime: 0x6a9ef515, blocks: 0xb 00010000:00010000:1.0:1788802328.751979:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1788802328.752006:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802328.752021:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f630ccd6/0x6ecba1490fc9ca6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef50 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.752043:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f630ccd6/0x6ecba1490fc9ca6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef50 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.752060:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3600, rc 0) 00000100:00100000:1.0:1788802328.752138:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:11071:x1875694872250240:12345-192.168.201.57@tcp:101:bash.0 Request processed in 280us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802328.752145:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00080000:2.0:1788802328.752194:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788802328.756151:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802328.756721:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872250368 00000100:00100000:3.0:1788802328.756739:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872250368 00002000:00010000:3.0:1788802328.756809:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788802328.756815:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d04541f80 with x1875694872250368 ext(0->18446744073709551615) 00002000:00010000:3.0:1788802328.756833:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d04541f80. 00000100:00100000:3.0:1788802328.756918:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:3.0:1788802328.756930:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872250368:12345-192.168.201.57@tcp:10:bash.0 00002000:00010000:3.0:1788802328.757564:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788802328.757587:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788802325 -> 1788802328 00002000:00010000:3.0:1788802328.757590:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788802323 -> 1788802323 00002000:00010000:3.0:1788802328.757593:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788802325 -> 1788802328 00002000:00010000:3.0:1788802328.757596:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788802328.757825:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2359:x1875694872250368:12345-192.168.201.57@tcp:10:bash.0 Request processed in 893us (1685us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788802328.757835:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00002000:00010000:3.0:1788802328.757842:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788802328.757846:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d04541f80 with x1875694872250368 ext(0->18446744073709551615) 00002000:00010000:3.0:1788802328.757853:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d04541f80. 00000100:00100000:0.0:1788802328.849883:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802328.850102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872250496 00000100:00100000:2.0:1788802328.850115:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872250496 00000100:00100000:2.0:1788802328.850191:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 193 00000100:00100000:2.0:1788802328.850203:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11560:x1875694872250496:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:2.0:1788802328.850393:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.850417:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.850432:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.850644:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.850654:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.850662:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.850988:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.850999:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851007:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802328.851066:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851082:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851101:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851109:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851116:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802328.851121:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851131:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851148:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:2.0:1788802328.851152:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802328.851158:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851165:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9ca73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851182:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851188:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851194:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851199:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216ec00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802328.851209:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851215:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851223:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d013eff00) 00010000:00010000:2.0:1788802328.851809:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802328.851817:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851826:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9ca7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851851:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851858:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851864:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851869:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216ea00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802328.851873:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851880:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851890:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:2.0:1788802328.851893:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802328.851907:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.851913:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ca81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802328.855049:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11560:x1875694872250496:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 4824us (5161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802328.855072:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 193 00000100:00100000:0.0:1788802328.906910:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802328.907041:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872250752 00000100:00100000:1.0:1788802328.907055:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872250752 00000100:00100000:1.0:1788802328.907143:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 194 00000100:00100000:1.0:1788802328.907158:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+32:11563:x1875694872250752:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802328.907191:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802328.907221:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9ca88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef57 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.907383:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9ca8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.907404:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9ca8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.907421:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9ca8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.907466:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9ca96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.907475:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9ca96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.907482:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9ca96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.907930:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9ca9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.907943:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9ca9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.907951:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9ca9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802328.907965:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788802328.908103:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9ca8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908112:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9ca8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908120:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9ca8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908127:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802328.908133:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9ca8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908154:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9ca8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908169:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:1.0:1788802328.908172:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802328.908179:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9ca8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908186:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9ca8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908204:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9ca96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908211:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9ca96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908217:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9ca96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908222:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802328.908224:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9ca96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908231:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9ca96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908296:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d05184600) 00010000:00010000:1.0:1788802328.908309:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802328.908313:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9ca96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908330:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9ca96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908397:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9ca88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef57 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908413:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9ca9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef57 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802328.908420:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:1.0:1788802328.908423:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788802328.908427:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3000, rc 0) 00000100:00100000:1.0:1788802328.908518:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:11563:x1875694872250752:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1364us (1625us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788802328.908527:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 194 00000100:00100000:1.0:1788802328.912379:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802328.912567:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872250880 00000100:00100000:0.0:1788802328.912580:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872250880 00000100:00100000:0.0:1788802328.912668:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 195 00000100:00100000:0.0:1788802328.912683:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:11563:x1875694872250880:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:0.0:1788802328.912792:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.912816:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef42 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.912826:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.912874:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef42 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.912907:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef42 expref: 34 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802328.912925:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892168320:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802328.913056:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72780 going to sleep for 11 seconds 00000100:00100000:0.0:1788802328.916646:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802328.916840:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892168320:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802328.916880:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802328.916960:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872251136 00000100:00100000:3.0:1788802328.916969:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872251136 00000100:00100000:3.0:1788802328.917041:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:3.0:1788802328.917052:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:5599:x1875694872251136:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788802328.917864:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:5599:x1875694872251136:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 809us (1230us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788802328.917875:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:1.0:1788802328.920770:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802328.920896:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872251264 00000100:00100000:2.0:1788802328.920911:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872251264 00010000:00010000:2.0:1788802328.920970:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef42 expref: 36 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802328.921050:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 72 00000100:00100000:2.0:1788802328.921063:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:2360:x1875694872251264:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802328.921082:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802328.921091:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef42 expref: 36 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.921107:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef42 expref: 36 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.921136:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ca50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef42 expref: 36 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.921157:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:2.0:1788802328.921162:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.921192:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.921201:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802328.921363:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802328.921437:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:2360:x1875694872251264:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 376us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802328.921575:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 72 00010000:00010000:0.0:1788802328.922870:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.922887:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.922935:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.922943:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.922950:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.922956:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802328.922961:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.922970:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.922989:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:0.0:1788802328.923010:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788802328.923017:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802328.923023:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9caab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802328.923133:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:11563:x1875694872250880:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 10446us (10763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802328.923144:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 195 00000100:00100000:1.0:1788802328.928515:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802328.928657:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872251520 00000100:00100000:3.0:1788802328.928671:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872251520 00000100:00100000:3.0:1788802328.928768:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:3.0:1788802328.928782:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+34:11563:x1875694872251520:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802328.929148:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:11563:x1875694872251520:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 369us (656us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788802328.929179:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:3.0:1788802328.972579:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788802328.973232:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892168448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802328.973802:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802328.976361:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892168448 00000100:00100000:0.0:1788802328.976384:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892168448 00000100:00100000:0.0:1788802328.976710:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788802328.976724:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892168448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788802328.976789:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802328.976894:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892168448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (3094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802328.976899:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788802328.976994:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892168448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802329.017420:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802329.017662:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872251776 00000100:00100000:0.0:1788802329.017677:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872251776 00000100:00100000:0.0:1788802329.017759:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 196 00000100:00100000:0.0:1788802329.017772:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+35:11574:x1875694872251776:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:0.0:1788802329.017807:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802329.017835:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cab2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef5e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.017936:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cab9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.017979:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cab9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.017994:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cab9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018014:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9cac0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018022:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9cac0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018029:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9cac0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018727:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018742:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018752:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802329.018765:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788802329.018904:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cab9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018913:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cab9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018921:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cab9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018936:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802329.018941:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cab9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018952:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cab9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018968:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802329.018972:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802329.018978:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cab9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.018985:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cab9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.019002:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9cac0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.019008:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9cac0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.019015:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9cac0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.019021:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802329.019023:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9cac0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.019030:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9cac0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.019049:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02db8f00) 00010000:00010000:0.0:1788802329.019051:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802329.019054:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9cac0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.019060:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0e00/0x6ecba1490fc9cac0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.019118:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cab2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef5e expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.019135:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef5e expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.019143:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:0.0:1788802329.019145:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802329.019148:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0c00, rc 0) 00000100:00100000:0.0:1788802329.019635:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:11574:x1875694872251776:12345-192.168.201.57@tcp:101:cat.0 Request processed in 1863us (2231us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788802329.019646:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 196 00000100:00100000:1.0:1788802329.025061:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.025158:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872252032 00000100:00100000:3.0:1788802329.025174:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872252032 00000100:00100000:3.0:1788802329.025370:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:3.0:1788802329.025385:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:11574:x1875694872252032:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:3.0:1788802329.026135:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+38:11574:x1875694872252032:12345-192.168.201.57@tcp:35:cat.0 Request processed in 746us (1085us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788802329.026145:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:1.0:1788802329.046178:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.046386:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872252288 00000100:00100000:3.0:1788802329.046401:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872252288 00000100:00100000:3.0:1788802329.046490:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 197 00000100:00100000:3.0:1788802329.046513:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+38:11575:x1875694872252288:12345-192.168.201.57@tcp:36:rm.0 00010000:00010000:3.0:1788802329.046595:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788802329.046632:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef5e expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.046657:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9ca9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef57 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.046672:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9ca65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef49 expref: 36 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.046711:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21100) 00010000:00010000:3.0:1788802329.046726:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802329.046756:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cad5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.046773:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.046787:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.046805:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.046813:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.046820:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.047133:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9cae3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.047143:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9cae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.047151:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9cae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788802329.047855:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788802329.047867:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381994627742ns, next at 382994625166ns, rc = 0 00010000:00010000:3.0:1788802329.047951:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.047964:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.047973:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.047981:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.047988:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.047995:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048017:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788802329.048042:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9cae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048049:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9cae3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048056:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9cae3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048062:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802329.048068:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9cae3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048076:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9cae3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048094:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21000) 00010000:00010000:3.0:1788802329.048097:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788802329.048102:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9cae3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048108:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9cae3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048128:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048135:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cad5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048141:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cad5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048146:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802329.048149:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cad5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048156:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cad5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048164:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:3.0:1788802329.048166:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802329.048170:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cad5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.048177:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cad5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802329.048196:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfec0d98 reply state 000000001c1174a4 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802329.048207:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788802329.048380:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+37:11575:x1875694872252288:12345-192.168.201.57@tcp:36:rm.0 Request processed in 1866us (2214us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788802329.048390:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 197 00010000:00010000:1.0:1788802329.048847:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802329.048856:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.048863:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802329.048867:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.048894:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.048907:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff910d02e21000) 00010000:00010000:1.0:1788802329.048909:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788802329.048913:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.048920:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9caea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.048942:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802329.048944:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802329.048946:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802329.051281:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.051315:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.051324:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.051330:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802329.051334:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.051342:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.051359:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02e21500) 00010000:00010000:2.0:1788802329.051361:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802329.051366:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.051390:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9cadc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802329.097956:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.098347:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872252544 00000100:00100000:3.0:1788802329.098362:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872252544 00000100:00100000:3.0:1788802329.098459:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 198 00000100:00100000:3.0:1788802329.098473:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+36:11581:x1875694872252544:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788802329.098653:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802329.098682:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9caf1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef65 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.098849:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9caf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.098869:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9caf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.098886:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9caf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.098903:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.098910:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.098942:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788802329.100057:0:9415:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788802329.100366:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.100384:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.100400:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.100467:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9caf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.100475:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9caf8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.100484:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9caf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.100492:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802329.101094:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9caf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.101107:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9caf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.101125:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:3.0:1788802329.101128:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802329.101152:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9caf8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.101161:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8800/0x6ecba1490fc9caf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802329.101181:0:9415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b524d76d reply state 0000000023f8cc3d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802329.101194:0:9415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788802329.101479:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9caf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef65 expref: 39 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.101566:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef65 expref: 38 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.101576:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d02e21e00) 00010000:00010000:3.0:1788802329.101579:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788802329.101582:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8e00, rc 0) 00000100:00100000:3.0:1788802329.101735:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+39:11581:x1875694872252544:12345-192.168.201.57@tcp:101:bash.0 Request processed in 3264us (3794us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788802329.101746:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 198 00000100:00100000:1.0:1788802329.106281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802329.106681:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872252672 00000100:00100000:0.0:1788802329.106700:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872252672 00000100:00100000:0.0:1788802329.106812:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:0.0:1788802329.106827:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2360:x1875694872252672:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802329.106859:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802329.106892:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9cb14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef6c expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788802329.106959:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802329.106992:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1788802329.106997:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802329.107008:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9cb14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef6c expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.107033:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9cb14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef6c expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.107052:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0400, rc 0) 00000100:00100000:0.0:1788802329.107134:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2360:x1875694872252672:12345-192.168.201.57@tcp:101:bash.0 Request processed in 311us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802329.107142:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00080000:1.0:1788802329.109419:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788802329.110596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:2.0:1788802329.110768:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.110786:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.110797:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.110804:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802329.110811:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.110821:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.110848:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02e21100) 00010000:00010000:2.0:1788802329.110852:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802329.110859:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.110865:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9e00/0x6ecba1490fc9caff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802329.111104:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872252800 00000100:00100000:3.0:1788802329.111118:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872252800 00000100:00100000:3.0:1788802329.111409:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:3.0:1788802329.111425:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:11581:x1875694872252800:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788802329.111464:0:8127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802329.111490:0:8127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef73 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.111632:0:8127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9cb14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef6c expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.111644:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802329.111649:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802329.111655:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.111704:0:8127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9cb14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef6c expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.111722:0:8127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9cb14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef6c expref: 7 pid: 6688 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802329.111742:0:8127:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8127:1875694892168576:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802329.111912:0:8127:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3a096e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788802329.115464:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802329.115977:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872252928 00000100:00100000:2.0:1788802329.115992:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872252928 00010000:00010000:2.0:1788802329.116057:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9cb14 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef6c expref: 8 pid: 6688 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802329.116322:0:8127:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8127:1875694892168576:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802329.116367:0:8127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 8 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.116390:0:8127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8800, rc 0) 00000100:00100000:2.0:1788802329.116642:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:2.0:1788802329.116656:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872252928:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802329.116679:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802329.116715:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9cb14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef6c expref: 8 pid: 6688 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.116732:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9cb14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef6c expref: 8 pid: 6688 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.116770:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029267438/0x6ecba1490fc9cb14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef6c expref: 8 pid: 6688 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.116791:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802329.116795:0:7624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802329.116805:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.116819:0:7624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.116864:0:7624:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802329.116882:0:7624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7624:1875694892168704:192.168.201.57@tcp:105: 00000100:00100000:2.0:1788802329.116994:0:7624:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08174240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802329.117049:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:11581:x1875694872252800:12345-192.168.201.57@tcp:101:bash.0 Request processed in 5627us (6622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802329.117058:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:2.0:1788802329.120353:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802329.120427:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872253184 00000100:00100000:0.0:1788802329.120441:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872253184 00000100:00100000:0.0:1788802329.120532:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:0.0:1788802329.120544:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+38:11581:x1875694872253184:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:0.0:1788802329.121036:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+39:11581:x1875694872253184:12345-192.168.201.57@tcp:35:bash.0 Request processed in 491us (695us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788802329.121045:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:3.0:1788802329.121393:0:7624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7624:1875694892168704:192.168.201.57@tcp:105: 00010000:00010000:3.0:1788802329.121425:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802329.121464:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2359:x1875694872252928:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 4812us (6028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802329.121474:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:2.0:1788802329.266386:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.266518:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872253312 00000100:00100000:3.0:1788802329.266534:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872253312 00000100:00100000:3.0:1788802329.266621:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 199 00000100:00100000:3.0:1788802329.266635:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+39:11597:x1875694872253312:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802329.266669:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802329.266700:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.266793:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9cb29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.266812:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9cb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.266827:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9cb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802329.266876:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788802329.266881:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802329.266906:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9cb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.266938:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef7a expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.266988:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9cb29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef7a expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.266997:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:3.0:1788802329.267001:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788802329.267005:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8400, rc 0) 00000100:00100000:3.0:1788802329.267103:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+40:11597:x1875694872253312:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 470us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802329.267112:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 199 00000100:00100000:3.0:1788802329.270869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802329.271130:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872253568 00000100:00100000:1.0:1788802329.271146:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872253568 00000100:00100000:1.0:1788802329.271221:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 200 00000100:00100000:1.0:1788802329.271283:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+40:11597:x1875694872253568:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802329.271323:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802329.271352:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9cb30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef81 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.271517:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cb37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.271558:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.271573:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802329.271588:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788802329.271755:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9cb30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef81 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.271778:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cb37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef81 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.271789:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d02e21e00) 00010000:00010000:1.0:1788802329.271792:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802329.271797:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2600, rc 0) 00000100:00100000:1.0:1788802329.271881:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+42:11597:x1875694872253568:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 603us (1028us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788802329.271890:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 200 00000100:00100000:1.0:1788802329.276353:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.276462:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872253824 00000100:00100000:3.0:1788802329.276477:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872253824 00000100:00100000:3.0:1788802329.276563:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 201 00000100:00100000:3.0:1788802329.276577:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+42:11597:x1875694872253824:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802329.276613:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802329.276647:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef88 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.276792:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cb4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.276813:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.276829:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802329.276870:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788802329.277045:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef88 expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.277068:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cb4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef88 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.277078:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d02e21e00) 00010000:00010000:3.0:1788802329.277081:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788802329.277085:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9c00, rc 0) 00000100:00100000:3.0:1788802329.277175:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+44:11597:x1875694872253824:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 600us (838us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788802329.277184:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 201 00000100:00100000:2.0:1788802329.284014:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802329.284184:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872253952 00000100:00100000:1.0:1788802329.284196:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872253952 00000100:00100000:1.0:1788802329.284338:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:1.0:1788802329.284351:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+44:2359:x1875694872253952:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802329.284372:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802329.284405:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cb37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef81 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.284725:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d02e21e00) 00010000:00010000:1.0:1788802329.284734:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802329.284818:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+43:2359:x1875694872253952:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 469us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802329.284828:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:1.0:1788802329.286868:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802329.286972:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872254080 00000100:00100000:0.0:1788802329.286986:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872254080 00000100:00100000:0.0:1788802329.287059:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:0.0:1788802329.287071:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+6:2357:x1875694872254080:12345-192.168.201.57@tcp:1:lfs.0 00010000:00010000:0.0:1788802329.287149:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.287174:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 6 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.287185:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802329.287190:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788802329.287196:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.287413:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 6 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.287432:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 6 pid: 8127 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802329.287613:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d0453dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875694892168832:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802329.287782:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72000 going to sleep for 11 seconds 00000100:00100000:0.0:1788802329.293849:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802329.293935:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872254208 00000100:00100000:1.0:1788802329.293951:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872254208 00002000:00100000:1.0:1788802329.294044:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff910d3a65a300 x1875694872254208/t0(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:470/0 lens 504/0 e 0 to 0 dl 1788802340 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788802329.294058:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d3a65a300 with x1875694872254208 ext(0->8) 00010000:00010000:1.0:1788802329.294069:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 7 pid: 8127 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.294089:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 7 pid: 8127 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788802329.294098:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910d3a65a300 00000100:00100000:1.0:1788802329.294133:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:1.0:1788802329.294144:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872254208:12345-192.168.201.57@tcp:4:lfs.0 00000100:00100000:1.0:1788802329.295155:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2360:x1875694872254208:12345-192.168.201.57@tcp:4:lfs.0 Request processed in 1004us (1314us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788802329.295169:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00002000:00100000:1.0:1788802329.295182:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff910d3a65a300 x1875694872254208/t4294967308(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:470/0 lens 504/448 e 0 to 0 dl 1788802340 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788802329.295200:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d3a65a300 with x1875694872254208 ext(0->8) 00010000:00010000:1.0:1788802329.295210:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 9 pid: 8127 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.295228:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 9 pid: 8127 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788802329.295269:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff910d3a65a300 00000100:00100000:3.0:1788802329.297906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802329.298082:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d0453dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1875694892168832:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802329.298122:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802329.298273:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872254336 00000100:00100000:1.0:1788802329.298283:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872254336 00010000:00010000:1.0:1788802329.298340:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 9 pid: 8127 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802329.298392:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:1.0:1788802329.298404:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2358:x1875694872254336:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802329.298426:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788802329.298665:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788802329.298669:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788802329 00002000:00010000:1.0:1788802329.298672:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788802329 00002000:00010000:1.0:1788802329.298675:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788802329 00010000:00010000:1.0:1788802329.298683:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 9 pid: 8127 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.298699:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 9 pid: 8127 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.298755:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5c35e1f/0x6ecba1490fc9cb1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef73 expref: 9 pid: 8127 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.298779:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802329.298785:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802329.298792:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.298804:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.298843:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802329.298964:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2358:x1875694872254336:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 561us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802329.298973:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 74 00010000:00010000:2.0:1788802329.299089:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.299101:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.299134:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.299143:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.299153:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.299162:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1a00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802329.299167:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.299192:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.299206:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.299214:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c1cd30b/0x6ecba1490fc9cb5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802329.299328:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2357:x1875694872254080:12345-192.168.201.57@tcp:1:lfs.0 Request processed in 12258us (12475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802329.299337:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:3.0:1788802329.302622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802329.302744:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872254592 00000100:00100000:0.0:1788802329.302757:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872254592 00000100:00100000:0.0:1788802329.302859:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:0.0:1788802329.302871:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+43:11597:x1875694872254592:12345-192.168.201.57@tcp:35:lfs.0 00000004:00010000:0.0:1788802329.302962:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cb4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef88 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802329.303340:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788802329.303386:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788802329.304043:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788802329.304114:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.304136:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef65 expref: 47 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.304145:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.304196:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef65 expref: 47 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.304216:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef65 expref: 47 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802329.304650:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875694892168960:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802329.304870:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72780 going to sleep for 11 seconds 00000100:00100000:2.0:1788802329.307788:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875694892168960:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802329.307830:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802329.311137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802329.311290:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872254720 00000100:00100000:2.0:1788802329.311312:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872254720 00010000:00010000:2.0:1788802329.311372:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef65 expref: 48 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802329.311426:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:2.0:1788802329.311437:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+48:2359:x1875694872254720:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802329.311456:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802329.311465:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef65 expref: 48 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.311490:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef65 expref: 48 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.311535:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cb06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef65 expref: 48 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.311559:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d02e21e00) 00010000:00010000:2.0:1788802329.311565:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.311576:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.311586:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.311617:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802329.311693:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+47:2359:x1875694872254720:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 257us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802329.311700:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 75 00010000:00010000:0.0:1788802329.311863:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.311872:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802329.312039:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788802329.312323:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788802329.312472:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875694892169088:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788802329.312541:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802329.312594:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d167b0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788802329.312674:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892169088 00000100:00100000:1.0:1788802329.312682:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892169088 00000100:00100000:1.0:1788802329.312730:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788802329.312740:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875694892169088:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788802329.312826:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875694892169088:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 89us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802329.312833:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788802329.312928:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875694892169088:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788802329.315700:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788802329.315834:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875694892169216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788802329.315924:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802329.316030:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d358d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788802329.316853:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892169216 00000100:00100000:0.0:1788802329.316868:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892169216 00000100:00100000:1.0:1788802329.317074:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788802329.317088:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875694892169216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788802329.317690:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1875694892169216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 603us (1763us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788802329.317701:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788802329.317982:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33e02d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875694892169216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788802329.318091:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788802329.318148:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.318162:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.318170:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.318177:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802329.318183:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.318193:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.318211:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d02e21e00) 00010000:00010000:0.0:1788802329.318215:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788802329.318396:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.318404:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb61 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788802329.319067:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788802329.319208:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788802329.319655:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382266415205ns, next at 383266409922ns, rc = 0 00000001:00080000:0.0:1788802329.319669:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788802329.319737:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d02e21e00) 00010000:00010000:0.0:1788802329.319742:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788802329.319752:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cb4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef88 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802329.319967:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+50:11597:x1875694872254592:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 17097us (17360us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788802329.319979:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00000020:00080000:0.0:1788802329.319986:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788802329.323043:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802329.323195:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872254848 00000100:00100000:1.0:1788802329.323208:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872254848 00000100:00100000:1.0:1788802329.323744:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 202 00000100:00100000:1.0:1788802329.323759:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+50:11597:x1875694872254848:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802329.323793:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802329.323824:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cb68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef8f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.323907:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cb68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef8f expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.323925:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cb68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef8f expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.323949:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802329.323953:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788802329.323957:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2600, rc 0) 00000100:00100000:1.0:1788802329.324080:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+51:11597:x1875694872254848:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 324us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802329.324089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 202 00000100:00100000:2.0:1788802329.326813:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.326911:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872255104 00000100:00100000:3.0:1788802329.326925:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872255104 00000100:00100000:3.0:1788802329.326997:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:3.0:1788802329.327009:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+51:11597:x1875694872255104:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802329.327383:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+52:11597:x1875694872255104:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 373us (582us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788802329.327391:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:0.0:1788802329.409623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.409830:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872255232 00000100:00100000:3.0:1788802329.409862:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872255232 00000100:00100000:3.0:1788802329.409943:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 203 00000100:00100000:3.0:1788802329.409957:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+52:11607:x1875694872255232:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:3.0:1788802329.410067:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.410089:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.410105:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.410122:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.410129:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.410136:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.410460:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.410470:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.410478:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802329.411308:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411334:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411342:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411373:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411381:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802329.411386:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411395:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411414:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:2.0:1788802329.411418:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802329.411425:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411431:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9a00/0x6ecba1490fc9cb6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411593:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411602:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411609:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411615:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802329.411618:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411636:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411646:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02e21700) 00010000:00010000:2.0:1788802329.411648:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802329.411652:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411659:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8c00/0x6ecba1490fc9cb76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411680:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411686:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411692:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411698:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802329.411700:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411705:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411713:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:2.0:1788802329.411716:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802329.411719:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.411736:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cb7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802329.411927:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+52:11607:x1875694872255232:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 1966us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802329.411937:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 203 00000100:00100000:3.0:1788802329.452604:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802329.452735:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872255488 00000100:00100000:0.0:1788802329.452746:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872255488 00000100:00100000:0.0:1788802329.452813:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 204 00000100:00100000:0.0:1788802329.452824:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+52:11610:x1875694872255488:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802329.452848:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802329.452886:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef96 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.452960:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cb8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.452976:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453007:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453023:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cb92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453031:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453038:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453175:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453185:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453193:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802329.453203:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788802329.453364:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453372:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cb8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453380:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cb8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453387:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802329.453398:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cb8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453407:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cb8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453421:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802329.453424:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802329.453429:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cb8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453437:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cb8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453451:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453458:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cb92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453465:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453471:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802329.453474:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453480:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cb92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453487:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02db8300) 00010000:00010000:0.0:1788802329.453490:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802329.453499:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cb92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453505:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cb92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453550:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cb84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef96 expref: 55 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453564:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef96 expref: 54 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.453572:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802329.453575:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802329.453578:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1600, rc 0) 00000100:00100000:0.0:1788802329.453652:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:11610:x1875694872255488:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 829us (1059us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788802329.453660:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 204 00000100:00100000:1.0:1788802329.455802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802329.456344:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872255616 00000100:00100000:0.0:1788802329.456355:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872255616 00000100:00100000:0.0:1788802329.456420:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 205 00000100:00100000:0.0:1788802329.456432:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:11610:x1875694872255616:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:0.0:1788802329.456503:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.456521:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.456534:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.456571:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.456578:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cba7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.456586:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.456592:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802329.456597:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.456605:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cba7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.456618:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802329.456622:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788802329.456627:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cba7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.456633:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802329.456765:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:11610:x1875694872255616:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 335us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802329.456773:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 205 00000100:00100000:3.0:1788802329.465791:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802329.465909:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872255872 00000100:00100000:2.0:1788802329.465920:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872255872 00000100:00100000:2.0:1788802329.465981:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:2.0:1788802329.465992:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+54:11610:x1875694872255872:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788802329.466272:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:11610:x1875694872255872:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 280us (490us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788802329.466279:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00000001:00080000:3.0:1788802329.531773:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1788802329.531790:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788802329.531796:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788802329.551114:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.551990:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872256128 00000100:00100000:3.0:1788802329.552002:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872256128 00000100:00100000:3.0:1788802329.552075:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 206 00000100:00100000:3.0:1788802329.552086:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a68bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:11620:x1875694872256128:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:3.0:1788802329.552111:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802329.552114:0:9415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788802329.552149:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8400/0x6ecba1490fc9cb29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef7a expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.552168:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:3.0:1788802329.552173:0:9415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802329.552187:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cbae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edef9d expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.552608:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.552653:0:9415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef96 expref: 55 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.552663:0:9415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.552700:0:9415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef96 expref: 55 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.552716:0:9415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef96 expref: 55 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802329.552730:0:9415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9415:1875694892169344:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802329.552821:0:9415:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d10b57600 going to sleep for 11 seconds 00000100:00100000:1.0:1788802329.565383:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.565463:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872256256 00000100:00100000:3.0:1788802329.565473:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872256256 00010000:00010000:3.0:1788802329.565514:0:7624:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef96 expref: 56 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802329.565559:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00100000:3.0:1788802329.565571:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:2360:x1875694872256256:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802329.565586:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802329.565593:0:7624:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef96 expref: 56 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.565635:0:7624:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef96 expref: 56 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.565659:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:3.0:1788802329.565664:0:7624:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.565673:0:7624:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.565681:0:7624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.565701:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802329.565767:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+56:2360:x1875694872256256:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 198us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802329.565775:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 76 00010000:00010000:0.0:1788802329.566421:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cb99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef96 expref: 55 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802329.566441:0:9415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9415:1875694892169344:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802329.566465:0:9415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.566474:0:9415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.566480:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802329.566501:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788802329.566676:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9000/0x6ecba1490fc9cbae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef9d expref: 56 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.566693:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef9d expref: 55 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.566701:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802329.566704:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788802329.566707:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0a00, rc 0) 00000100:00100000:0.0:1788802329.566754:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a68bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:11620:x1875694872256128:12345-192.168.201.57@tcp:101:bash.0 Request processed in 14670us (15650us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788802329.566762:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 206 00000100:00100000:1.0:1788802329.570701:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802329.570878:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872256512 00000100:00100000:0.0:1788802329.570888:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872256512 00000100:00100000:0.0:1788802329.570950:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 207 00000100:00100000:0.0:1788802329.570960:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+55:11620:x1875694872256512:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:0.0:1788802329.571285:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.571318:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.571331:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802329.571657:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788802329.571683:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068bb9ba2 reply state 00000000fcb46fa8 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802329.571692:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788802329.571810:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+58:11620:x1875694872256512:12345-192.168.201.57@tcp:36:bash.0 Request processed in 849us (1118us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788802329.571818:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 207 00000020:00080000:0.0:1788802329.571822:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788802329.580485:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:2.0:1788802329.580666:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.580678:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.580686:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.580693:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802329.580697:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.580705:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.580741:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:2.0:1788802329.580745:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802329.580750:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.580756:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cbc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802329.581034:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872256640 00000100:00100000:1.0:1788802329.581045:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872256640 00000100:00100000:1.0:1788802329.581107:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 208 00000100:00100000:1.0:1788802329.581118:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+57:11620:x1875694872256640:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788802329.581154:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802329.581174:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9cbca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefa4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.581313:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.581326:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef9d expref: 58 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.581334:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.581377:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef9d expref: 58 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.581390:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef9d expref: 58 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802329.581404:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892169472:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802329.581477:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1020b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802329.583857:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892169472:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802329.583908:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802329.584471:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802329.584600:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872256768 00000100:00100000:2.0:1788802329.584608:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872256768 00010000:00010000:2.0:1788802329.584658:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef9d expref: 59 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802329.584700:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 77 00000100:00100000:2.0:1788802329.584709:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:2360:x1875694872256768:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802329.584723:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802329.584730:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef9d expref: 59 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.584742:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef9d expref: 59 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.584764:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cbb5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef9d expref: 59 pid: 9415 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.584780:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:2.0:1788802329.584785:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.584816:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.584823:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.584856:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802329.584915:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+58:2360:x1875694872256768:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 207us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802329.584923:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 77 00010000:00010000:0.0:1788802329.585125:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.585142:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802329.585188:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788802329.585192:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802329.585211:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.585278:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9cbca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefa4 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.585303:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefa4 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.585311:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802329.585313:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802329.585316:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3200, rc 0) 00000100:00100000:0.0:1788802329.585347:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+57:11620:x1875694872256640:12345-192.168.201.57@tcp:101:bash.0 Request processed in 4232us (4873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802329.585354:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 208 00000100:00100000:2.0:1788802329.598605:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.605098:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872257024 00000100:00100000:3.0:1788802329.605115:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872257024 00000100:00100000:0.0:1788802329.606504:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:0.0:1788802329.606515:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+57:11620:x1875694872257024:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:0.0:1788802329.610568:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+58:11620:x1875694872257024:12345-192.168.201.57@tcp:35:bash.0 Request processed in 4040us (11961us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788802329.610584:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 59 00010000:00010000:0.0:1788802329.678533:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802329.699651:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802329.699781:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872257152 00000100:00100000:2.0:1788802329.699799:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872257152 00000100:00100000:2.0:1788802329.699947:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 209 00000100:00100000:2.0:1788802329.699959:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+58:11626:x1875694872257152:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802329.699987:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802329.700009:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9cbd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.700080:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cbdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.700096:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.700110:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802329.702038:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788802329.702063:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802329.702094:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.702134:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216fa00/0x6ecba1490fc9cbd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefab expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.702155:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cbdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefab expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.702165:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:2.0:1788802329.702168:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802329.702172:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216ee00, rc 0) 00000100:00100000:2.0:1788802329.702297:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:11626:x1875694872257152:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 2328us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802329.702306:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 209 00000100:00100000:2.0:1788802329.714466:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802329.715568:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872257280 00000100:00100000:0.0:1788802329.715582:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872257280 00000100:00100000:0.0:1788802329.715654:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 210 00000100:00100000:0.0:1788802329.715666:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:11626:x1875694872257280:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802329.715688:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802329.715713:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cbe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefb2 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.715810:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cbed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.715826:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cbed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.715838:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cbed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.715853:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cbf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.715860:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.716054:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.718784:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cbfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.718809:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cbfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.718822:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cbfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802329.719056:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788802329.719061:0:9415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802329.719085:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cbfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719099:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cbfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719109:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cbed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719116:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cbed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719123:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cbed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719130:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802329.719393:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cbed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719402:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cbed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719430:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802329.719433:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802329.719439:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cbed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719445:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cbed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719463:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719470:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cbf4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719477:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719483:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802329.719485:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719491:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cbf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719498:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02db8300) 00010000:00010000:0.0:1788802329.719500:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802329.719503:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cbf4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719509:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cbf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719561:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cbe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb2 expref: 61 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719576:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cbfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb2 expref: 60 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.719584:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802329.719586:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802329.719589:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0c00, rc 0) 00000100:00100000:0.0:1788802329.719727:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:11626:x1875694872257280:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 4062us (5269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802329.719737:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 210 00000100:00100000:3.0:1788802329.726949:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802329.728371:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.729405:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872257664 00000100:00100000:3.0:1788802329.729418:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872257664 00000100:00100000:3.0:1788802329.729496:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:3.0:1788802329.729507:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:2357:x1875694872257664:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802329.729521:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802329.729559:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cbfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb2 expref: 60 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.729579:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:3.0:1788802329.729584:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802329.729645:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:2357:x1875694872257664:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 141us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802329.729652:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:0.0:1788802329.730998:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872257536 00000100:00100000:0.0:1788802329.731009:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872257536 00000100:00100000:0.0:1788802329.731058:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 211 00000100:00100000:0.0:1788802329.731067:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:11626:x1875694872257536:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802329.731085:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802329.731102:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cc02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefb9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.731528:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.731545:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefa4 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.731555:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.731604:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefa4 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.731620:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefa4 expref: 60 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802329.731634:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892169600:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802329.731765:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d10b57180 going to sleep for 11 seconds 00000100:00100000:0.0:1788802329.738634:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a94000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892169600:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802329.738665:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802329.739086:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.739457:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872257792 00000100:00100000:3.0:1788802329.739466:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872257792 00010000:00010000:3.0:1788802329.739507:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefa4 expref: 61 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802329.739539:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:3.0:1788802329.739548:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:2359:x1875694872257792:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802329.739564:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802329.739571:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefa4 expref: 61 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.739583:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefa4 expref: 61 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.739605:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cbd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefa4 expref: 61 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.739623:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:3.0:1788802329.739628:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.739652:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.739659:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.739692:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802329.739740:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:2359:x1875694872257792:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 192us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802329.739748:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 78 00010000:00010000:2.0:1788802329.739857:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.739877:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802329.739897:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788802329.740044:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cc02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb9 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.740062:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb9 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802329.740076:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:2.0:1788802329.740079:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788802329.740082:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0400, rc 0) 00000100:00100000:2.0:1788802329.740110:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:11626:x1875694872257536:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 9045us (13175us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788802329.740118:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 211 00000100:00100000:2.0:1788802329.746430:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802329.746575:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872258048 00000100:00100000:3.0:1788802329.746587:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872258048 00000100:00100000:3.0:1788802329.746664:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788802329.746676:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:11626:x1875694872258048:12345-192.168.201.57@tcp:103:lfs.0 00010000:00010000:3.0:1788802329.746694:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802329.746723:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cb68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef8f expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802329.746743:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:3.0:1788802329.746748:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802329.746907:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:11626:x1875694872258048:12345-192.168.201.57@tcp:103:lfs.0 Request processed in 233us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802329.746915:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:2.0:1788802329.752035:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802329.755345:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872258176 00000100:00100000:1.0:1788802329.755366:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872258176 00000100:00100000:1.0:1788802329.755573:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 212 00000100:00100000:1.0:1788802329.755588:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:11626:x1875694872258176:12345-192.168.201.57@tcp:58:lfs.0 00010000:00010000:1.0:1788802329.755714:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.755736:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802329.755748:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788802329.755942:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788802329.756042:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:11626:x1875694872258176:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 455us (4020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802329.756050:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 212 00000100:00100000:2.0:1788802329.760162:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802329.763783:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872258304 00000100:00100000:0.0:1788802329.763801:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872258304 00000100:00100000:0.0:1788802329.764216:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 213 00000100:00100000:0.0:1788802329.764229:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+59:11626:x1875694872258304:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802329.764334:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802329.764355:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cc1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefc0 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.764419:0:9415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.764432:0:9415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cc1e lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefc0 expref: 60 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.764453:0:9415:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.764483:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cc1e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefc0 expref: 60 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.764498:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802329.764501:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788802329.764505:0:9415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cc1e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefc0 expref: 60 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802329.764513:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1000, rc 0) 00000100:00100000:0.0:1788802329.764625:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:11626:x1875694872258304:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 399us (4473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802329.764633:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 213 00000040:00080000:3.0:1788802330.060708:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802330.060724:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802330.060784:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788802330.060793:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788802330.061005:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892169728:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788802330.061164:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3a096180 going to sleep for 11 seconds 00000100:00100000:3.0:1788802330.069785:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892169728:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788802330.070084:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802330.070181:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872258432 00000100:00100000:0.0:1788802330.070189:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872258432 00000100:00100000:0.0:1788802330.070295:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 214 00000100:00100000:0.0:1788802330.070305:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:11627:x1875694872258432:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788802330.070338:0:9415:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788802330.070450:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:11627:x1875694872258432:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 146us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802330.070459:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 214 00000100:00080000:1.0:1788802330.070537:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802330.075753:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802330.076144:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872258560 00000100:00100000:1.0:1788802330.076155:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872258560 00000100:00100000:1.0:1788802330.076225:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 215 00000100:00100000:1.0:1788802330.076263:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:11627:x1875694872258560:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788802330.076347:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cc25 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076365:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cc25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076399:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cc25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076419:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076427:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076434:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076458:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076467:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076474:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802330.076514:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788802330.076518:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802330.076531:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076540:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cc25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076546:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cc25 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076563:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cc25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076568:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802330.076573:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cc25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076580:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cc25 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076591:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:1.0:1788802330.076595:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802330.076599:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cc25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076606:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cc25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076630:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076636:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc2c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076642:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076646:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802330.076649:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076665:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc2c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076673:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff910d05184c00) 00010000:00010000:1.0:1788802330.076675:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802330.076678:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc2c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076683:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076697:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076703:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076709:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076713:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802330.076716:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076722:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076729:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802330.076731:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802330.076734:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.076751:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802330.076838:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:11627:x1875694872258560:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 602us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802330.076846:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 215 00000100:00100000:3.0:1788802330.082480:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802330.082574:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872258816 00000100:00100000:0.0:1788802330.082584:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872258816 00000100:00100000:0.0:1788802330.082657:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 216 00000100:00100000:0.0:1788802330.082669:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+60:11627:x1875694872258816:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802330.082694:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802330.082733:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cc3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefc7 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.082837:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cc41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.082853:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.082875:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802330.082887:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788802330.082985:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.082993:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cc41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.082999:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cc41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.083005:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802330.083009:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cc41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.083017:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cc41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.083028:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802330.083032:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788802330.083036:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cc41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.083054:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cc41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.083100:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cc3a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefc7 expref: 62 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.083111:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:0.0:1788802330.083114:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788802330.083118:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9cc3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefc7 expref: 62 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.083127:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1600, rc 0) 00000100:00100000:0.0:1788802330.083235:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:11627:x1875694872258816:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 568us (763us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788802330.083270:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 216 00000100:00100000:3.0:1788802330.090800:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802330.090915:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872258944 00000100:00100000:1.0:1788802330.090933:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872258944 00000100:00100000:1.0:1788802330.091058:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 217 00000100:00100000:1.0:1788802330.091069:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:11627:x1875694872258944:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788802330.091105:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788802330.091227:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:11627:x1875694872258944:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 159us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802330.091235:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 217 00000100:00100000:2.0:1788802330.098803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802330.098899:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872259200 00000100:00100000:0.0:1788802330.098911:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872259200 00000100:00100000:0.0:1788802330.098967:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 218 00000100:00100000:0.0:1788802330.098979:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:11627:x1875694872259200:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802330.099001:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802330.099004:0:9415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788802330.099034:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cbdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefab expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.099055:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802330.099061:0:9415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788802330.099088:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cc4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefce expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788802330.099520:0:9415:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788802330.099715:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cc56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.099729:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cc56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.099739:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cc56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.099790:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9cc4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefce expref: 63 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.099807:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cc56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefce expref: 62 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.099815:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d02db8300) 00010000:00010000:0.0:1788802330.099818:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802330.099820:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1400, rc 0) 00000100:00100000:0.0:1788802330.100551:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+62:11627:x1875694872259200:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1571us (1754us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788802330.100560:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 218 00000100:00100000:3.0:1788802330.107876:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802330.107948:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872259456 00000100:00100000:1.0:1788802330.107959:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872259456 00000100:00100000:1.0:1788802330.108013:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 219 00000100:00100000:1.0:1788802330.108024:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+62:11627:x1875694872259456:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788802330.108081:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802330.108114:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cc56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefce expref: 62 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.108157:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d02db8300) 00010000:00010000:1.0:1788802330.108173:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802330.108196:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.108227:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.108263:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109636:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5040d53d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109654:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5040d53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109664:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5040d53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109739:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109746:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109754:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109760:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802330.109764:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109771:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109782:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:1.0:1788802330.109796:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802330.109801:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109808:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3200/0x6ecba1490fc9cc64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109822:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5040d53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109827:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5040d53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109833:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5040d53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109838:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802330.109841:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5040d53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109847:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5040d53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109853:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5040d53d (ffff910d05184c00) 00010000:00010000:1.0:1788802330.109856:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802330.109859:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5040d53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.109864:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9cc6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5040d53d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802330.115090:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:11627:x1875694872259456:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 7053us (7214us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788802330.115121:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 219 00000100:00100000:3.0:1788802330.122956:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.123121:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872259584 00000100:00100000:2.0:1788802330.123132:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872259584 00000100:00100000:2.0:1788802330.123201:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 220 00000100:00100000:2.0:1788802330.123211:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+61:11627:x1875694872259584:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802330.123234:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802330.123294:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefd5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.123337:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.123350:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.123570:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.123696:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefd5 expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.123715:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefd5 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.123723:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:2.0:1788802330.123726:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788802330.123729:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216ee00, rc 0) 00000100:00100000:2.0:1788802330.123789:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+62:11627:x1875694872259584:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 579us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.123796:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 220 00000100:00100000:0.0:1788802330.131553:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.131725:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872259840 00000100:00100000:2.0:1788802330.131737:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872259840 00000100:00100000:2.0:1788802330.131835:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 221 00000100:00100000:2.0:1788802330.131847:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+62:11627:x1875694872259840:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788802330.131944:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.131963:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.131976:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788802330.132305:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1788802330.132316:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383079077398ns, next at 384079074036ns, rc = 0 00000004:00010000:2.0:1788802330.132437:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095dfd3fb reply state 000000007ed53aa6 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802330.132447:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788802330.132579:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+64:11627:x1875694872259840:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 732us (1035us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788802330.132587:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 221 00010000:00010000:3.0:1788802330.136118:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.136155:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.136163:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.136169:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216ec00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802330.136175:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.136183:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.136209:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:3.0:1788802330.136212:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788802330.136219:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.136226:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ec00/0x6ecba1490fc9cc80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802330.140667:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.140993:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872259968 00000100:00100000:2.0:1788802330.141005:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872259968 00000100:00100000:2.0:1788802330.141073:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 222 00000100:00100000:2.0:1788802330.141083:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+63:11627:x1875694872259968:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802330.141109:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802330.141144:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefdc expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.141226:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefdc expref: 64 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.141264:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefdc expref: 64 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.141295:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:2.0:1788802330.141299:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788802330.141303:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216ea00, rc 0) 00000100:00100000:2.0:1788802330.141430:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+64:11627:x1875694872259968:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 347us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.141437:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 222 00000100:00100000:1.0:1788802330.145533:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.145692:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872260096 00000100:00100000:2.0:1788802330.145717:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872260096 00000100:00100000:2.0:1788802330.145826:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:2.0:1788802330.145838:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2360:x1875694872260096:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788802330.146167:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:2360:x1875694872260096:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 331us (700us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788802330.146175:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:3.0:1788802330.149991:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.150271:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872260352 00000100:00100000:2.0:1788802330.150293:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872260352 00000100:00100000:2.0:1788802330.150346:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:2.0:1788802330.150368:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+64:11627:x1875694872260352:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788802330.150656:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+65:11627:x1875694872260352:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 300us (675us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788802330.150664:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00080000:1.0:1788802330.153396:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788802330.155602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.155736:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872260608 00000100:00100000:2.0:1788802330.155748:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872260608 00000100:00100000:2.0:1788802330.155811:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 223 00000100:00100000:2.0:1788802330.155822:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3383ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+65:11627:x1875694872260608:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788802330.155948:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3383ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+65:11627:x1875694872260608:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 128us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.155955:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 223 00000100:00100000:0.0:1788802330.161348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.161759:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872260736 00000100:00100000:2.0:1788802330.161769:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872260736 00000100:00100000:2.0:1788802330.161825:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 224 00000100:00100000:2.0:1788802330.161832:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+65:11627:x1875694872260736:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802330.161851:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802330.161877:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cc8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefe3 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.161935:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9cc95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.161947:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9cc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.161956:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9cc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802330.161986:0:9415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802330.162000:0:9415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9cc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.162018:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cc8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefe3 expref: 67 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.162032:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9cc95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefe3 expref: 66 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.162039:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:2.0:1788802330.162041:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788802330.162044:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216e000, rc 0) 00000100:00100000:2.0:1788802330.162099:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+66:11627:x1875694872260736:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 267us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.162103:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 224 00000100:00100000:3.0:1788802330.164896:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.164973:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872260864 00000100:00100000:2.0:1788802330.164982:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872260864 00000100:00100000:2.0:1788802330.165047:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:2.0:1788802330.165054:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d035b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+10:2359:x1875694872260864:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802330.165076:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802330.165095:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028402268/0x6ecba1490fc9cc9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefea expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788802330.165119:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ef51a, blocks: 0x1 00010000:00010000:2.0:1788802330.165144:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1788802330.165150:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802330.165159:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028402268/0x6ecba1490fc9cc9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefea expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.165180:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028402268/0x6ecba1490fc9cc9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefea expref: 11 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.165193:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216f200, rc 0) 00000100:00100000:2.0:1788802330.165350:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d035b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:2359:x1875694872260864:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 294us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.165358:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:0.0:1788802330.168727:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802330.168858:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872261120 00000100:00100000:1.0:1788802330.168866:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872261120 00000100:00100000:1.0:1788802330.168932:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 225 00000100:00100000:1.0:1788802330.168940:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+66:11627:x1875694872261120:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788802330.169030:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+66:11627:x1875694872261120:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802330.169037:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 225 00000100:00100000:1.0:1788802330.173775:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.173875:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872261248 00000100:00100000:2.0:1788802330.173885:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872261248 00000100:00100000:2.0:1788802330.173966:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:2.0:1788802330.173978:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:11627:x1875694872261248:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802330.174000:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802330.174018:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeff1 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.174064:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028402268/0x6ecba1490fc9cc9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefea expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.174071:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802330.174074:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802330.174078:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.174110:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028402268/0x6ecba1490fc9cc9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefea expref: 12 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.174120:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028402268/0x6ecba1490fc9cc9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefea expref: 12 pid: 6690 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802330.174133:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875694892169856:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802330.174350:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08174f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802330.176905:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee60380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875694892169856:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802330.176939:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.176964:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216f400, rc 0) 00000100:00100000:2.0:1788802330.177046:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:11627:x1875694872261248:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 3070us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.177056:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:0.0:1788802330.179035:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802330.179226:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872261376 00000100:00100000:3.0:1788802330.179322:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872261376 00010000:00010000:2.0:1788802330.179548:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028402268/0x6ecba1490fc9cc9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefea expref: 12 pid: 6690 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802330.179615:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:2.0:1788802330.179628:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08319450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:2360:x1875694872261376:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802330.179646:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802330.179676:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028402268/0x6ecba1490fc9cc9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefea expref: 12 pid: 6690 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.179691:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028402268/0x6ecba1490fc9cc9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefea expref: 12 pid: 6690 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.179715:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028402268/0x6ecba1490fc9cc9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefea expref: 12 pid: 6690 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.179735:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802330.179740:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802330.179748:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.179758:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.179806:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802330.179844:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee60380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1875694892169984:192.168.201.57@tcp:105: 00000100:00100000:2.0:1788802330.179933:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08174f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802330.183807:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee60380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1875694892169984:192.168.201.57@tcp:105: 00010000:00010000:2.0:1788802330.183840:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802330.183893:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08319450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:2360:x1875694872261376:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 4267us (4866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.183905:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788802330.184510:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.184592:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872261504 00000100:00100000:2.0:1788802330.184600:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872261504 00002000:00100000:2.0:1788802330.184653:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff910d082e8700 x1875694872261504/t0(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:471/0 lens 504/0 e 0 to 0 dl 1788802341 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788802330.184661:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d082e8700 with x1875694872261504 ext(0->12) 00002000:00010000:2.0:1788802330.184665:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d082e8700 00000100:00100000:2.0:1788802330.184687:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788802330.184695:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+11:2359:x1875694872261504:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788802330.185048:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:2359:x1875694872261504:12345-192.168.201.57@tcp:4:lhsmtool_posix.0 Request processed in 353us (539us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788802330.185055:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00002000:00100000:2.0:1788802330.185062:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff910d082e8700 x1875694872261504/t4294967320(0) o4->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:471/0 lens 504/448 e 0 to 0 dl 1788802341 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788802330.185070:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d082e8700 with x1875694872261504 ext(0->12) 00002000:00010000:2.0:1788802330.185074:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d082e8700 00000100:00100000:0.0:1788802330.187933:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.188028:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872261632 00000100:00100000:2.0:1788802330.188038:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872261632 00000100:00100000:2.0:1788802330.188109:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 226 00000100:00100000:2.0:1788802330.188117:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+66:11627:x1875694872261632:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788802330.221317:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+66:11627:x1875694872261632:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 33185us (33381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802330.221333:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 226 00000001:00080000:1.0:1788802330.221474:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:1.0:1788802330.221500:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788802330.221563:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910d167b0900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788802330.221567:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d04544000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910d167b0480 00000020:00080000:1.0:1788802330.221570:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d04544300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910d3ef7f800 00000001:00080000:1.0:1788802330.221589:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788802330.221594:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000020:00080000:1.0:1788802330.221609:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910d03cafcc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788802330.221612:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d0522ee00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910d03caf9c0 00000020:00080000:1.0:1788802330.221615:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d0522ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910d343a1c00 00000004:00080000:1.0:1788802330.221630:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1788802330.221656:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788802330.221856:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788802330.221979:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892170112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788802330.222056:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802330.222095:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788802330.222102:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892170240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788802330.222126:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802330.222158:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892170112 00000100:00100000:1.0:1788802330.222165:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892170112 00000100:00100000:1.0:1788802330.222227:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892170240 00000100:00100000:1.0:1788802330.222230:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892170240 00000100:00100000:1.0:1788802330.222292:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788802330.222303:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875694892170112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788802330.222329:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1788802330.222357:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.222377:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f630ccd6/0x6ecba1490fc9ca6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef50 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.222386:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788802330.222390:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802330.222395:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.222424:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f630ccd6/0x6ecba1490fc9ca6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef50 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.222438:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f630ccd6/0x6ecba1490fc9ca6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef50 expref: 12 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802330.222463:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33e00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1875694892170368:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802330.222509:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1020b840 going to sleep for 11 seconds 00000100:00080000:1.0:1788802330.222523:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788802330.222536:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788802330.222544:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875694892170240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788802330.222676:0:8127:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788802330.222680:0:8127:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788802330 00002000:00010000:1.0:1788802330.222682:0:8127:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788802330.222685:0:8127:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788802330 -> 1788802330 00002000:00010000:1.0:1788802330.222687:0:8127:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788802330.222727:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1875694892170240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (600us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788802330.222735:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:1.0:1788802330.222783:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d33e02680/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788802330.222790:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892170240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788802330.223029:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788802330.223039:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892170496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788802330.223073:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802330.223149:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892170496 00000100:00100000:1.0:1788802330.223155:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892170496 00000100:00100000:1.0:1788802330.223585:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788802330.223593:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892170496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788802330.223612:0:8127:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1788802330.223643:0:8127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ef519, atime: 0x6a9ef519, ctime: 0x6a9ef519, blocks: 0xb 00010000:00010000:1.0:1788802330.223651:0:8127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9ccb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.223679:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1788802330.223683:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802330.223693:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9ccb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.223709:0:8127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9ccb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.223720:0:8127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9ccb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.223728:0:8127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9ccb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.223748:0:8127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788802330.224406:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875694892170496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 810us (1328us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788802330.224414:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1788802330.224444:0:6703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802330.224450:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9ccb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.224458:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2e00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802330.224462:0:6703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9ccb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.224485:0:6703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9ccb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.224502:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9ccb1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.224510:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9ccb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.224530:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802330.224532:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802330.224534:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802330.224566:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788802330.224573:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d41db4e00, transno 4294967307 00000004:00080000:1.0:1788802330.224584:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1788802330.224610:0:3312:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff910d3fae9c00 x1875694892170496/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788802346 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788802330.224622:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d3fae9c00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788802330.224628:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892170496:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788802330.226746:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802330.226869:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33e00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1875694892170368:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802330.226902:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802330.227578:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802330.227837:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872261888 00000100:00100000:1.0:1788802330.227847:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872261888 00010000:00010000:1.0:1788802330.227894:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f630ccd6/0x6ecba1490fc9ca6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef50 expref: 13 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802330.227958:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:1.0:1788802330.227967:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+13:2360:x1875694872261888:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802330.227984:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802330.227990:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f630ccd6/0x6ecba1490fc9ca6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef50 expref: 13 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.228002:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f630ccd6/0x6ecba1490fc9ca6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef50 expref: 13 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.228028:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f630ccd6/0x6ecba1490fc9ca6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.57@tcp remote: 0x6d80875826edef50 expref: 13 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.228047:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802330.228051:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802330.228057:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.228066:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.228093:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802330.228156:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:2360:x1875694872261888:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 189us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802330.228163:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 80 00010000:00010000:3.0:1788802330.228302:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.228312:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.228321:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.228329:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.228348:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788802330.228917:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3313:x1875694892170112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6614us (6859us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788802330.228926:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788802330.228950:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872261760 00000100:00100000:3.0:1788802330.228955:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872261760 00000100:00100000:3.0:1788802330.228984:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:3.0:1788802330.228991:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+12:2360:x1875694872261760:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788802330.229100:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d33e01f80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788802330.229108:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892170112:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788802330.229309:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802330.229316:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.229326:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802330.229330:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.229340:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.229355:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.229362:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acd0b795/0x6ecba1490fc9ccaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.229381:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802330.229383:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802330.229385:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788802330.231136:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788802330.278048:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1788802330.278065:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1788802330.278071:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:2.0:1788802330.278085:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:1.0:1788802330.278413:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2360:x1875694872261760:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 49414us (51668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802330.278425:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:2.0:1788802330.282830:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802330.282950:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872262144 00000100:00100000:0.0:1788802330.282962:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872262144 00000100:00100000:0.0:1788802330.283074:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 227 00000100:00100000:0.0:1788802330.283085:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:11627:x1875694872262144:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788802330.283145:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802330.283175:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216e000/0x6ecba1490fc9cc95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefe3 expref: 20 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.283198:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:0.0:1788802330.283218:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788802330.283299:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.283315:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.283326:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788802330.283953:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4d83970 reply state 000000007a3f975e transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802330.283966:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788802330.284079:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:11627:x1875694872262144:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 995us (1263us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788802330.284088:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 227 00010000:00010000:3.0:1788802330.286906:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.286927:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.286936:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.286943:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802330.286948:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.286957:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.286974:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:3.0:1788802330.286978:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802330.286984:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.286990:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802330.292338:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802330.292432:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872262272 00000100:00100000:0.0:1788802330.292455:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872262272 00000100:00100000:0.0:1788802330.292537:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:0.0:1788802330.292549:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872262272:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788802330.292845:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788802330.292849:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788802330 -> 1788802329 00002000:00010000:0.0:1788802330.292852:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788802329 00002000:00010000:0.0:1788802330.292855:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788802330 -> 1788802329 00002000:00010000:0.0:1788802330.292858:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788802330.292937:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872262272:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 389us (609us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788802330.292945:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:2.0:1788802330.296560:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802330.296843:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872262528 00000100:00100000:0.0:1788802330.296856:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872262528 00000100:00100000:0.0:1788802330.296923:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 228 00000100:00100000:0.0:1788802330.296936:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:11627:x1875694872262528:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788802330.297027:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.297070:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefd5 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.297080:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.297120:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefd5 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.297137:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefd5 expref: 20 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802330.297152:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892170624:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802330.297317:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243600 going to sleep for 11 seconds 00000100:00100000:2.0:1788802330.301334:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802330.301434:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872262656 00000100:00100000:1.0:1788802330.301457:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872262656 00010000:00010000:1.0:1788802330.301517:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefd5 expref: 21 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802330.301589:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:1.0:1788802330.301600:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:2359:x1875694872262656:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802330.301618:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802330.301626:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefd5 expref: 21 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.301639:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefd5 expref: 21 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.301663:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:1.0:1788802330.301668:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.301678:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.301686:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.301706:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802330.301769:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:2359:x1875694872262656:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 170us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802330.301776:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 81 00010000:00010000:0.0:1788802330.302839:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ee00/0x6ecba1490fc9cc79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefd5 expref: 20 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802330.302867:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875694892170624:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802330.302899:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.302909:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.302915:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.302951:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.302975:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.302982:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.302987:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802330.302991:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.303000:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.303013:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:0.0:1788802330.303016:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788802330.303021:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.303028:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1a00/0x6ecba1490fc9ccbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802330.303107:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:11627:x1875694872262528:12345-192.168.201.57@tcp:55:lhsmtool_posix.0 Request processed in 6173us (6560us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788802330.303116:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 228 00000100:00100000:2.0:1788802330.307720:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802330.307801:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872262784 00000100:00100000:3.0:1788802330.307825:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872262784 00000100:00100000:3.0:1788802330.307887:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:3.0:1788802330.307899:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2358:x1875694872262784:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788802330.307952:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.307974:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.307983:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802330.307988:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788802330.307992:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.308028:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.308044:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 8 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802330.308061:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875694892170752:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802330.308149:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3a096480 going to sleep for 11 seconds 00000100:00100000:3.0:1788802330.312310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802330.312495:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872262912 00000100:00100000:1.0:1788802330.312505:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872262912 00010000:00010000:1.0:1788802330.312541:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 9 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802330.312599:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:1.0:1788802330.312607:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2359:x1875694872262912:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802330.312620:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802330.312640:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 9 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.312650:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 9 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.312674:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802330.312678:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788802330.312683:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.312690:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.312707:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802330.312771:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+9:2359:x1875694872262912:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 164us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802330.312779:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 82 00010000:00010000:2.0:1788802330.313574:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9cca3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff1 expref: 8 pid: 6687 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802330.313596:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1875694892170752:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802330.313627:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.313638:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.313644:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.313674:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.313691:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.313698:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.313704:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802330.313708:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.313717:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.313741:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.313747:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000524dc98f/0x6ecba1490fc9ccc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802330.313817:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2358:x1875694872262784:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 5920us (6111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.313825:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 70 00000100:00100000:3.0:1788802330.318642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802330.318943:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872263168 00000100:00100000:1.0:1788802330.318956:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872263168 00000100:00100000:1.0:1788802330.319020:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 229 00000100:00100000:1.0:1788802330.319032:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:11627:x1875694872263168:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788802330.319140:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9cccd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.319159:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9cccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.319172:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9cccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.319448:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.319460:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefdc expref: 20 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.319482:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.319519:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefdc expref: 20 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.319535:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefdc expref: 20 pid: 9415 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802330.319551:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892170880:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802330.319649:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08aff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788802330.324326:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802330.324492:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872263296 00000100:00100000:0.0:1788802330.324505:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872263296 00010000:00010000:0.0:1788802330.324550:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc87 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefdc expref: 21 pid: 9415 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802330.324594:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:0.0:1788802330.324621:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:2360:x1875694872263296:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788802330.324638:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802330.324646:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc87 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefdc expref: 21 pid: 9415 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.324660:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefdc expref: 21 pid: 9415 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.324681:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:0.0:1788802330.324687:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.324696:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.324704:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.324723:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802330.324783:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:2360:x1875694872263296:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 164us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802330.324791:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 83 00010000:00010000:1.0:1788802330.326083:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9cc87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefdc expref: 20 pid: 9415 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802330.326110:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892170880:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802330.326160:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.326171:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.326177:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788802330.326440:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788802330.326593:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788802330.326651:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788802330.326732:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875694892171008:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788802330.326786:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802330.327018:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d011ca180 going to sleep for 11 seconds 00000100:00100000:3.0:1788802330.328151:0:12359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892171008 00000100:00100000:3.0:1788802330.328164:0:12359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892171008 00000100:00100000:2.0:1788802330.329123:0:12359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788802330.329139:0:12359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5844:x1875694892171008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788802330.329344:0:12359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5844:x1875694892171008:12345-0@lo:1000:mdt00_002.0 Request processed in 210us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.329352:0:12359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788802330.329449:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788802330.329456:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1788802330.329486:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d33e02680, transno 4294967321 00000004:00080000:3.0:1788802330.329556:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d33e01f80, transno 4294967322 00000100:00100000:3.0:1788802330.330821:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33e00000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875694892171008:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788802330.332600:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788802330.332783:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee60700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875694892171136:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788802330.332856:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802330.332946:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d012edcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802330.333041:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892171136 00000100:00100000:3.0:1788802330.333049:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892171136 00000100:00100000:3.0:1788802330.333134:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788802330.333145:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875694892171136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788802330.333464:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875694892171136:12345-0@lo:1000:mdt00_002.0 Request processed in 321us (606us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788802330.333481:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788802330.333834:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee60700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875694892171136:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788802330.333876:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.333888:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.333896:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.333901:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802330.333907:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.333916:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.333933:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:2.0:1788802330.333936:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788802330.333942:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.333948:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3600/0x6ecba1490fc9ccd4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.334002:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.334009:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.334015:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.334021:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802330.334024:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.334030:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.334037:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:2.0:1788802330.334040:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788802330.334048:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cc1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefc0 expref: 23 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.334061:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cc1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefc0 expref: 23 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.334072:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cc1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefc0 expref: 23 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.334108:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cc1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefc0 expref: 23 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802330.334136:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee63480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892171264:192.168.201.57@tcp:105: 00000100:00100000:2.0:1788802330.334407:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08aff000 going to sleep for 11 seconds 00000100:00100000:2.0:1788802330.338831:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee63480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875694892171264:192.168.201.57@tcp:105: 00010000:00010000:2.0:1788802330.338869:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.338882:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9cc17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.338922:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ccdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.338937:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ccdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.338949:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ccdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.338961:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ccdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.338968:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ccdb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.338974:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ccdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.338980:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216ea00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802330.338985:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ccdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.339009:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ccdb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.339022:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:2.0:1788802330.339025:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802330.339030:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ccdb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.339035:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216ea00/0x6ecba1490fc9ccdb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.339046:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9cccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.339052:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9cccd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.339058:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9cccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.339063:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802330.339066:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9cccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.339071:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9cccd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.339079:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:2.0:1788802330.339081:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788802330.339083:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9cccd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.339100:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2400/0x6ecba1490fc9cccd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802330.339418:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:11627:x1875694872263168:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 20387us (20785us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788802330.339428:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 229 00000020:00080000:2.0:1788802330.339435:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788802330.340175:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802330.340181:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802330.340952:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788802330.340965:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788802330.344091:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.344183:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872263424 00000100:00100000:2.0:1788802330.344195:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872263424 00000100:00100000:2.0:1788802330.344284:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:2.0:1788802330.344296:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:11626:x1875694872263424:12345-192.168.201.57@tcp:49:lfs.0 00000100:00100000:2.0:1788802330.344475:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:11626:x1875694872263424:12345-192.168.201.57@tcp:49:lfs.0 Request processed in 182us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.344483:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:0.0:1788802330.348973:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.349061:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872263680 00000100:00100000:2.0:1788802330.349073:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872263680 00000100:00100000:2.0:1788802330.349130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:2.0:1788802330.349140:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+23:11627:x1875694872263680:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788802330.349870:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788802330.349979:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788802330.350029:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.350047:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.350059:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.350076:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.350082:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.350088:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802330.350123:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788802330.350212:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:11627:x1875694872263680:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 1070us (1247us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788802330.350220:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 62 00000020:00080000:2.0:1788802330.350226:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788802330.350457:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788802330.350466:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.350473:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802330.350477:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.350485:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.350497:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff910d013ef300) 00010000:00010000:3.0:1788802330.350500:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788802330.350512:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.350518:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d4216f400/0x6ecba1490fc9cce2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802330.350536:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802330.350538:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802330.350540:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802330.353174:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.353362:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872263936 00000100:00100000:2.0:1788802330.353372:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872263936 00000100:00100000:2.0:1788802330.353446:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 230 00000100:00100000:2.0:1788802330.353458:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:11626:x1875694872263936:12345-192.168.201.57@tcp:58:lfs.0 00000040:00080000:2.0:1788802330.353747:0:9415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788802330.353843:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:11626:x1875694872263936:12345-192.168.201.57@tcp:58:lfs.0 Request processed in 387us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802330.353853:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 230 00000100:00100000:1.0:1788802330.400291:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802330.400455:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872264064 00000100:00100000:0.0:1788802330.400464:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872264064 00000100:00100000:0.0:1788802330.400529:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 231 00000100:00100000:0.0:1788802330.400538:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+25:11629:x1875694872264064:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802330.400580:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802330.400601:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edeff8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.400663:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ccf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.400676:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ccf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.400686:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ccf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.400699:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9ccf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.400706:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9ccf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.400712:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9ccf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.400933:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.400944:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb9 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.400953:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.400988:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb9 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.401007:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb9 expref: 26 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802330.401028:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892171392:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802330.401332:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243600 going to sleep for 11 seconds 00000100:00100000:3.0:1788802330.405020:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802330.405119:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872264320 00000100:00100000:2.0:1788802330.405129:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872264320 00000100:00100000:2.0:1788802330.405188:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:2.0:1788802330.405199:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:5599:x1875694872264320:12345-192.168.201.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788802330.405499:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:5599:x1875694872264320:12345-192.168.201.57@tcp:35:ldlm_bl.0 Request processed in 301us (488us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788802330.405524:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 63 00000100:00100000:0.0:1788802330.406402:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875694892171392:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802330.406450:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802330.409369:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802330.409485:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872264448 00000100:00100000:1.0:1788802330.409496:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872264448 00010000:00010000:1.0:1788802330.409536:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb9 expref: 28 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802330.409577:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:1.0:1788802330.409588:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:2360:x1875694872264448:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802330.409609:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802330.409617:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb9 expref: 28 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.409630:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb9 expref: 28 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.409672:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0400/0x6ecba1490fc9cc09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edefb9 expref: 28 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.409689:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802330.409694:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.409704:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.409712:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802330.409748:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802330.409808:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+27:2360:x1875694872264448:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 221us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802330.409816:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 84 00010000:00010000:0.0:1788802330.410508:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410522:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802330.410572:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788802330.410578:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802330.410602:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410617:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410628:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ccf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410635:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ccf0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410657:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ccf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410663:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802330.410668:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ccf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410676:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ccf0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410689:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:0.0:1788802330.410692:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802330.410696:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ccf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410703:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9ccf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410718:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9ccf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410724:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9ccf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410729:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9ccf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410735:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1400 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802330.410738:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9ccf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410754:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9ccf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410764:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff910d02db8e00) 00010000:00010000:0.0:1788802330.410766:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802330.410770:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9ccf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410776:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9ccf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410815:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff8 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410831:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff8 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802330.410838:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802330.410840:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802330.410842:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1600, rc 0) 00000100:00100000:0.0:1788802330.410894:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11629:x1875694872264064:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 10357us (10660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802330.410902:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 231 00010000:00010000:1.0:1788802330.700673:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802331.020488:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802331.020513:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892171520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802331.020584:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802331.021401:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892171520 00000100:00100000:3.0:1788802331.021412:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892171520 00000100:00100000:3.0:1788802331.021482:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788802331.021492:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892171520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788802331.021514:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788802331.021578:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892171520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802331.021585:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788802331.021635:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892171520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802331.121142:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802331.121285:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872264576 00000100:00100000:1.0:1788802331.121295:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872264576 00000100:00100000:1.0:1788802331.121350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 300 00000100:00100000:1.0:1788802331.121360:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872264576:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802331.121445:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+13:2359:x1875694872264576:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 85us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802331.121453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 300 00000100:00100000:1.0:1788802331.124072:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802331.124147:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872264704 00000100:00100000:3.0:1788802331.124157:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872264704 00000100:00100000:3.0:1788802331.124228:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 161 00000100:00100000:3.0:1788802331.124284:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:2359:x1875694872264704:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802331.124363:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:2359:x1875694872264704:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 125us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802331.124382:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 161 00000100:00100000:2.0:1788802331.130817:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802331.130984:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872264832 00000100:00100000:3.0:1788802331.130995:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872264832 00000100:00080000:1.0:1788802331.131121:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802331.131162:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:3.0:1788802331.131176:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2359:x1875694872264832:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802331.131282:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2359:x1875694872264832:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 111us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802331.131290:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:3.0:1788802331.131765:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802331.131834:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802331.131932:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872265088 00000100:00100000:2.0:1788802331.131937:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872265088 00000100:00100000:2.0:1788802331.132010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 162 00000100:00100000:2.0:1788802331.132017:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872265088:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802331.132052:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2359:x1875694872265088:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 36us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802331.132069:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 162 00000100:00100000:1.0:1788802331.132071:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872264960 00000100:00100000:1.0:1788802331.132077:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872264960 00000100:00100000:1.0:1788802331.132115:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:1.0:1788802331.132123:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872264960:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802331.132173:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872264960:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 50us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802331.132179:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00080000:3.0:1788802331.132212:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788802331.249096:0:12506:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788802331.249105:0:12506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788802331.249136:0:12506:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788802331.249140:0:12506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788802331.404576:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802331.404586:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802331.404634:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788802331.404641:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788802331.404767:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d358bf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892171648:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788802331.404856:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08174240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802331.408527:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d358bf100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11677:1875694892171648:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788802331.413227:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802331.413297:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872265216 00000100:00100000:3.0:1788802331.413310:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872265216 00000100:00100000:3.0:1788802331.413370:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 232 00000100:00100000:3.0:1788802331.413382:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d358bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11641:x1875694872265216:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788802331.413421:0:9415:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788802331.413528:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d358bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11641:x1875694872265216:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 148us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802331.413549:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 232 00000100:00100000:1.0:1788802331.427225:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802331.427284:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872265472 00000100:00100000:1.0:1788802331.427294:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872265472 00000100:00100000:1.0:1788802331.427343:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 233 00000100:00100000:1.0:1788802331.427353:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+26:11641:x1875694872265472:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788802331.427376:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802331.427403:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9cd05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edefff expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802331.427532:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9cd0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802331.427550:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9cd0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802331.427564:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9cd0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802331.427589:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788802331.427724:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3000/0x6ecba1490fc9cd05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefff expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802331.427739:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9cd0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefff expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802331.427746:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802331.427748:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802331.427752:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3400, rc 0) 00000100:00100000:1.0:1788802331.427963:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:11641:x1875694872265472:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 610us (745us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788802331.427970:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 233 00000100:00100000:3.0:1788802331.439055:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802331.439161:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872265728 00000100:00100000:0.0:1788802331.439173:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872265728 00000100:00100000:0.0:1788802331.439497:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 234 00000100:00100000:0.0:1788802331.439510:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+28:11641:x1875694872265728:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788802331.439593:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9cd1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802331.439612:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9cd1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802331.439624:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9cd1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802331.439839:0:9415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9cd1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802331.439848:0:9415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9cd1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802331.439855:0:9415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9cd1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802331.439861:0:9415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802331.439865:0:9415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9cd1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802331.439871:0:9415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9cd1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802331.439882:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802331.439884:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788802331.439889:0:9415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9cd1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802331.439902:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1c00/0x6ecba1490fc9cd1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802331.440071:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:11641:x1875694872265728:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 562us (1030us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788802331.440080:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 234 00000040:00080000:3.0:1788802331.440112:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802331.440118:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802331.447719:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788802331.447740:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788802331.447828:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802331.447981:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802331.448036:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872265856 00000100:00100000:1.0:1788802331.448047:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872265856 00000100:00100000:1.0:1788802331.448123:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:1.0:1788802331.448133:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:2358:x1875694872265856:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802331.448149:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802331.448173:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3400/0x6ecba1490fc9cd0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefff expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802331.448202:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802331.448216:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802331.448231:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872266112 00000100:00100000:3.0:1788802331.448268:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872266112 00000100:00100000:3.0:1788802331.448298:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 64 00000100:00100000:1.0:1788802331.448299:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a621c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:2358:x1875694872265856:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 167us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802331.448305:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:11641:x1875694872266112:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788802331.448307:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:3.0:1788802331.448504:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:11641:x1875694872266112:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 198us (522us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788802331.448511:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 64 00010000:00010000:1.0:1788802331.727384:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802332.748461:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788802333.335889:0:12558:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788802333.335904:0:12558:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788802333.335956:0:12558:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788802333.335962:0:12558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788802333.584046:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892171776:0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.584149:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802333.584803:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892172032:0@lo:400:kworker.0 00000100:00100000:3.0:1788802333.584858:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802333.584933:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788802333.584940:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892172160:0@lo:400:kworker.0 00000100:00100000:3.0:1788802333.584967:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802333.585401:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892172160 00000100:00100000:2.0:1788802333.585414:0:8127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892172160 00000100:00100000:1.0:1788802333.586317:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892172288:0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.586387:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802333.586422:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788802333.586429:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892171904:0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.586455:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802333.586481:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892172416:0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.586508:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802333.586560:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892171776 00000100:00100000:1.0:1788802333.586569:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892171776 00000100:00100000:1.0:1788802333.586619:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788802333.587814:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892171776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.587916:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892171776:12345-0@lo:400:kworker.0 Request processed in 112us (3768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802333.587925:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788802333.587991:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892172032 00000100:00100000:1.0:1788802333.587999:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892172032 00000100:00100000:1.0:1788802333.588042:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892172288 00000100:00100000:1.0:1788802333.588046:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892172288 00000100:00100000:1.0:1788802333.588064:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892171904 00000100:00100000:1.0:1788802333.588068:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892171904 00000100:00100000:1.0:1788802333.588082:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788802333.588088:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892172032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.588134:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892172032:12345-0@lo:400:kworker.0 Request processed in 45us (3275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802333.588154:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788802333.588168:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788802333.588173:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892172288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.588202:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892172288:12345-0@lo:400:kworker.0 Request processed in 30us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802333.588208:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788802333.588232:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788802333.588255:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892171904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.588285:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892171904:12345-0@lo:400:kworker.0 Request processed in 47us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802333.588291:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788802333.588314:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892172416 00000100:00100000:1.0:1788802333.588318:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892172416 00000100:00100000:1.0:1788802333.588344:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788802333.588351:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892172416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.588383:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875694892172416:12345-0@lo:400:kworker.0 Request processed in 32us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802333.588390:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788802333.588449:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892172032:0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.588514:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892171904:0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.588528:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892172416:0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.588538:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892171776:0@lo:400:kworker.0 00000100:00100000:1.0:1788802333.588549:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892172288:0@lo:400:kworker.0 00000100:00100000:2.0:1788802333.589042:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788802333.589058:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892172160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802333.589117:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875694892172160:12345-0@lo:400:kworker.0 Request processed in 65us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802333.589124:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788802333.589207:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00080000:2.0:1788802333.589312:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802333.589320:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788802333.589323:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802333.590041:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872266368 00000100:00100000:0.0:1788802333.590053:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872266368 00000100:00100000:0.0:1788802333.590116:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 235 00000100:00100000:0.0:1788802333.590125:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+29:11661:x1875694872266368:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802333.590146:0:9415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802333.590173:0:9415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cd21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf006 expref: -99 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802333.590331:0:9415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cd28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802333.590350:0:9415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cd28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802333.590367:0:9415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cd28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802333.590381:0:9415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788802333.590541:0:9415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9cd21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf006 expref: 32 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802333.590586:0:9415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cd28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf006 expref: 31 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802333.590597:0:9415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:0.0:1788802333.590600:0:9415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788802333.590604:0:9415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1400, rc 0) 00000100:00100000:1.0:1788802333.592973:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892172160:0@lo:400:kworker.0 00000100:00080000:1.0:1788802333.595810:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802333.598453:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11661:x1875694872266368:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 8309us (9229us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788802333.598469:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 235 00000100:00100000:3.0:1788802333.604832:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802333.611199:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872266496 00000100:00100000:1.0:1788802333.611234:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872266496 00000100:00100000:1.0:1788802333.611342:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 236 00000100:00100000:1.0:1788802333.611355:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11661:x1875694872266496:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:1.0:1788802333.611455:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cd36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802333.611478:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802333.611493:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802333.611528:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802333.611535:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cd36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802333.611544:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cd36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802333.611551:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802333.611555:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cd36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802333.611564:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cd36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802333.611594:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802333.611597:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788802333.611604:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cd36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802333.611612:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2000/0x6ecba1490fc9cd36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802333.612392:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a65ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+31:11661:x1875694872266496:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 1030us (7563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802333.612406:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 236 00000100:00100000:1.0:1788802333.716904:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802333.717277:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872266624 00000100:00100000:3.0:1788802333.717292:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872266624 00000100:00100000:3.0:1788802333.717456:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 71 00000100:00100000:3.0:1788802333.717469:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2359:x1875694872266624:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:3.0:1788802333.717503:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802333.717558:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0276843/0x6ecba1490fc9cd3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf00d expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788802333.717594:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ef519, atime: 0x6a9ef519, ctime: 0x6a9ef519, blocks: 0xb 00010000:00010000:3.0:1788802333.717638:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=386s v=(0 0) 00010000:00010000:3.0:1788802333.717644:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788802333.717656:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0276843/0x6ecba1490fc9cd3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf00d expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802333.717682:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0276843/0x6ecba1490fc9cd3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf00d expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802333.717896:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9a00, rc 0) 00000100:00100000:3.0:1788802333.717991:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872266624:12345-192.168.201.57@tcp:101:cat.0 Request processed in 524us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802333.717999:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 71 00000100:00080000:1.0:1788802333.719559:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788802333.723190:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802333.725095:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872266752 00000100:00100000:0.0:1788802333.725119:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872266752 00002000:00100000:0.0:1788802333.726013:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff910d33e01f80 x1875694872266752/t0(0) o3->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:474/0 lens 488/0 e 0 to 0 dl 1788802344 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788802333.726029:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d33e01f80 with x1875694872266752 ext(0->4095) 00002000:00010000:0.0:1788802333.726038:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d33e01f80 00000100:00100000:0.0:1788802333.726169:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:0.0:1788802333.726187:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872266752:12345-192.168.201.57@tcp:3:cat.0 00000100:00100000:0.0:1788802333.726952:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+8:2359:x1875694872266752:12345-192.168.201.57@tcp:3:cat.0 Request processed in 763us (3769us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788802333.726965:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00002000:00100000:0.0:1788802333.726975:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff910d33e01f80 x1875694872266752/t0(0) o3->df790e2a-6b5b-4b00-92e8-29e1cf7bde69@192.168.201.57@tcp:474/0 lens 488/4536 e 0 to 0 dl 1788802344 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788802333.726985:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d33e01f80 with x1875694872266752 ext(0->4095) 00002000:00010000:0.0:1788802333.726999:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff910d33e01f80 00010000:00010000:1.0:1788802333.772602:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802334.093553:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802334.096905:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892172544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802334.097041:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802334.098196:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892172544 00000100:00100000:0.0:1788802334.098224:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892172544 00000100:00100000:0.0:1788802334.098677:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788802334.098691:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875694892172544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788802334.099178:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802334.099645:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875694892172544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 954us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802334.099655:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788802334.101554:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892172544:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788802334.698382:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1788802334.796889:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788802335.728402:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788802335.728421:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788802335.747733:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788802335.747778:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788802335.747855:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:1.0:1788802335.747874:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:0.0:1788802335.747930:0:5865:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff910d3a096c00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788802335.747936:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d054f9b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff910d3a096480 00000020:00080000:0.0:1788802335.747939:0:5865:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff910d054f9600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff910d1129bc00 00000020:00080000:1.0:1788802335.747976:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788802335.749685:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788802335.821639:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802336.141036:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892172672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802336.141136:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802336.141321:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892172672 00000100:00100000:2.0:1788802336.141344:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892172672 00000100:00100000:2.0:1788802336.141427:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788802336.141437:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892172672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788802336.141476:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788802336.141550:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802336.142522:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892172672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1082us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802336.142534:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788802336.142598:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788802336.142606:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff910d3fae9c00, transno 4294967310 00000100:00100000:1.0:1788802336.142664:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892172672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802336.243690:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802336.243736:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802336.243775:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802336.243805:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802336.243835:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802336.243851:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872266880 00000100:00100000:0.0:1788802336.243866:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872267392 00000100:00100000:1.0:1788802336.243878:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872266880 00000100:00100000:0.0:1788802336.243878:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872267392 00000100:00100000:1.0:1788802336.243939:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 302 00000100:00100000:0.0:1788802336.243942:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872267008 00000100:00100000:0.0:1788802336.243947:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872267008 00000100:00100000:1.0:1788802336.243953:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872266880:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802336.243970:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 166 00000100:00100000:0.0:1788802336.243978:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872267392:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802336.244065:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 167 00000100:00100000:3.0:1788802336.244078:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:2357:x1875694872267008:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802336.244142:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2357:x1875694872267392:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 164us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802336.244155:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 166 00000100:00100000:0.0:1788802336.244209:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872267136 00000100:00100000:0.0:1788802336.244213:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872267136 00000100:00100000:0.0:1788802336.244266:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872267264 00000100:00100000:0.0:1788802336.244268:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872267264 00000100:00100000:0.0:1788802336.244286:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:0.0:1788802336.244291:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872267136:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802336.244361:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:2.0:1788802336.244382:0:8127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2357:x1875694872267264:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802336.247210:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872266880:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 3247us (3518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802336.247227:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 302 00000100:00100000:0.0:1788802336.251884:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a622d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2357:x1875694872267136:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 7586us (8141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802336.251899:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:2.0:1788802336.251914:0:8127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2357:x1875694872267264:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 7541us (8074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802336.251925:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00080000:0.0:1788802336.251969:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788802336.251976:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788802336.251979:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802336.252019:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:2357:x1875694872267008:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 7729us (7995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802336.252029:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 167 00010000:00010000:2.0:1788802336.844750:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802337.868637:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788802338.636599:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788802338.636612:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802338.638602:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788802338.638626:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788802338.706108:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892172800:0@lo:400:kworker.0 00000100:00100000:2.0:1788802338.706292:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802338.706361:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08dbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892173312:0@lo:400:kworker.0 00000100:00100000:2.0:1788802338.706397:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802338.706430:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788802338.706436:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892172928:0@lo:400:kworker.0 00000100:00100000:2.0:1788802338.706462:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802338.706467:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892173056:0@lo:400:kworker.0 00000100:00100000:2.0:1788802338.706484:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892173440:0@lo:400:kworker.0 00000100:00100000:3.0:1788802338.706511:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802338.706525:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802338.706540:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788802338.706549:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08db9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892173184:0@lo:400:kworker.0 00000100:00100000:3.0:1788802338.706580:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802338.706628:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892173440 00000100:00100000:3.0:1788802338.706642:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892173440 00000100:00100000:0.0:1788802338.706685:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892172800 00000100:00100000:0.0:1788802338.706691:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892172800 00000100:00100000:3.0:1788802338.706714:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892173184 00000100:00100000:3.0:1788802338.706719:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892173184 00000100:00100000:0.0:1788802338.706737:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788802338.706750:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892172800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802338.706754:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788802338.706770:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892173440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802338.706827:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892173440:12345-0@lo:400:kworker.0 Request processed in 61us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802338.706834:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788802338.706839:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892172800:12345-0@lo:400:kworker.0 Request processed in 90us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802338.706847:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788802338.706884:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892173312 00000100:00100000:0.0:1788802338.706887:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892173312 00000100:00100000:0.0:1788802338.706915:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892172928 00000100:00100000:0.0:1788802338.706917:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892172928 00000100:00100000:0.0:1788802338.706930:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892173056 00000100:00100000:0.0:1788802338.706932:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892173056 00000100:00100000:0.0:1788802338.706949:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788802338.706955:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892173312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802338.707007:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892173312:12345-0@lo:400:kworker.0 Request processed in 52us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802338.707014:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788802338.707026:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788802338.707031:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892172928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802338.707058:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892172928:12345-0@lo:400:kworker.0 Request processed in 27us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802338.707064:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788802338.707075:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788802338.707081:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892173056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802338.707116:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892173056:12345-0@lo:400:kworker.0 Request processed in 37us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802338.707122:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788802338.707156:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788802338.707164:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892173184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802338.707197:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892173184:12345-0@lo:400:kworker.0 Request processed in 34us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802338.707203:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1788802338.707226:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788802338.707232:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788802338.707234:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788802338.707314:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892173184:0@lo:400:kworker.0 00000100:00100000:3.0:1788802338.707327:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892173056:0@lo:400:kworker.0 00000100:00100000:2.0:1788802338.707467:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08db8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892172928:0@lo:400:kworker.0 00000100:00100000:2.0:1788802338.707478:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788802338.707485:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788802338.707517:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892173440:0@lo:400:kworker.0 00000100:00100000:2.0:1788802338.707531:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892172800:0@lo:400:kworker.0 00000100:00100000:2.0:1788802338.707540:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08dbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892173312:0@lo:400:kworker.0 00010000:00010000:1.0:1788802338.893642:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802339.212420:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892173568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802339.212713:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802339.212820:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892173568 00000100:00100000:1.0:1788802339.212831:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892173568 00000100:00100000:1.0:1788802339.212894:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788802339.212906:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892173568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802339.212953:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802339.213008:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892173568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802339.213015:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788802339.213451:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892173568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788802339.228797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802339.228893:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872267520 00000100:00100000:3.0:1788802339.228907:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872267520 00000100:00100000:3.0:1788802339.229000:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 237 00000100:00100000:3.0:1788802339.229018:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:11305:x1875694872267520:12345-192.168.201.57@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788802339.229173:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:11305:x1875694872267520:12345-192.168.201.57@tcp:60:lhsmtool_posix.0 Request processed in 163us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802339.229198:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 237 00000100:00080000:1.0:1788802339.229418:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802339.246895:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802339.247399:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872267776 00000100:00100000:3.0:1788802339.247413:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872267776 00000100:00100000:3.0:1788802339.248188:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 65 00000100:00100000:3.0:1788802339.248207:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:11305:x1875694872267776:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788802339.248833:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:11305:x1875694872267776:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 628us (1949us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788802339.248842:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 65 00010000:00010000:2.0:1788802339.916717:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788802340.820917:0:5865:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1788802340.820950:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788802340.820996:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788802340.821012:0:5876:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788802340.955739:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802341.261784:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892173696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802341.261895:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802341.262132:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892173696 00000100:00100000:0.0:1788802341.262143:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892173696 00000100:00100000:0.0:1788802341.262224:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788802341.262262:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892173696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802341.262423:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802341.264058:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892173696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1810us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802341.264076:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788802341.266262:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802341.268645:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892173696:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788802341.313889:0:12761:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 13:32:19 (1788802339) 00000100:00100000:3.0:1788802341.362434:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802341.362494:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802341.362525:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802341.362544:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802341.362570:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802341.362615:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872268160 00000100:00100000:3.0:1788802341.362628:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872268160 00000100:00100000:2.0:1788802341.362645:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872267904 00000100:00100000:2.0:1788802341.362649:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872267904 00000100:00100000:3.0:1788802341.362697:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872268288 00000100:00100000:3.0:1788802341.362700:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872268288 00000100:00100000:2.0:1788802341.362702:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 304 00000100:00100000:2.0:1788802341.362713:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2358:x1875694872267904:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802341.362722:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:3.0:1788802341.362729:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2358:x1875694872268160:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802341.362798:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+13:2358:x1875694872267904:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 86us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802341.362806:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 304 00000100:00100000:0.0:1788802341.362848:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:0.0:1788802341.362858:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2358:x1875694872268288:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802341.365886:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2358:x1875694872268160:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 3139us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802341.365904:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:3.0:1788802341.365991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872268416 00000100:00100000:3.0:1788802341.366003:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872268416 00000100:00080000:1.0:1788802341.366786:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788802341.366796:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788802341.366813:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872268032 00000100:00100000:1.0:1788802341.366820:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872268032 00000100:00100000:1.0:1788802341.366896:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 171 00000100:00100000:1.0:1788802341.366908:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:2358:x1875694872268032:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802341.367000:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:2358:x1875694872268032:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 96us (4454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802341.367136:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 172 00000100:00100000:3.0:1788802341.367145:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2358:x1875694872268416:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802341.367174:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2358:x1875694872268416:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 32us (4649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802341.367181:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 172 00000100:00100000:1.0:1788802341.367841:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 171 00000100:00080000:1.0:1788802341.368180:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802341.370257:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2358:x1875694872268288:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 7359us (7644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802341.371846:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 102 00010000:00010000:0.0:1788802341.967657:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802342.990997:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802343.714323:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802343.714709:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872268544 00000100:00100000:3.0:1788802343.714725:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872268544 00000100:00100000:3.0:1788802343.714884:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 238 00000100:00100000:3.0:1788802343.714903:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+5:12326:x1875694872268544:12345-192.168.201.57@tcp:101:lsof.0 00010000:00010000:3.0:1788802343.714945:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802343.714985:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cd44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf014 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802343.715081:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cd4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802343.715101:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cd4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802343.715123:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cd4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802343.715171:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788802343.715175:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802343.715225:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cd4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802343.715285:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8e00/0x6ecba1490fc9cd44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf014 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802343.715326:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cd4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf014 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802343.715337:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d03b55b00) 00010000:00010000:3.0:1788802343.715341:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788802343.715345:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9c00, rc 0) 00000100:00100000:3.0:1788802343.715433:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d5134f2-023b-4d13-91da-559e8a611b5e+6:12326:x1875694872268544:12345-192.168.201.57@tcp:101:lsof.0 Request processed in 538us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802343.715441:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 238 00000100:00080000:1.0:1788802343.719500:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802343.820936:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892174080:0@lo:400:kworker.0 00000100:00100000:0.0:1788802343.821054:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802343.821153:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788802343.821160:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892174208:0@lo:400:kworker.0 00000100:00100000:0.0:1788802343.821191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802343.821338:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892173824:0@lo:400:kworker.0 00000100:00100000:1.0:1788802343.821395:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802343.821434:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d08c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892174336:0@lo:400:kworker.0 00000100:00100000:1.0:1788802343.821461:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802343.821481:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788802343.821486:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892173952:0@lo:400:kworker.0 00000100:00100000:1.0:1788802343.821508:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802343.821529:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892174464:0@lo:400:kworker.0 00000100:00100000:1.0:1788802343.821551:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802343.821585:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892174080 00000100:00100000:1.0:1788802343.821597:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892174080 00000100:00100000:1.0:1788802343.822053:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892174336 00000100:00100000:1.0:1788802343.822059:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892174336 00000100:00100000:1.0:1788802343.822076:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892173952 00000100:00100000:1.0:1788802343.822099:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892173952 00000100:00100000:1.0:1788802343.822125:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788802343.822134:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892174080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802343.822213:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892174080:12345-0@lo:400:kworker.0 Request processed in 80us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802343.822222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788802343.822286:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788802343.822293:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892174336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802343.822327:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892174336:12345-0@lo:400:kworker.0 Request processed in 35us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802343.822333:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788802343.822343:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788802343.822349:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892173952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802343.822376:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892173952:12345-0@lo:400:kworker.0 Request processed in 27us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802343.822382:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788802343.822406:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892174208 00000100:00100000:1.0:1788802343.822410:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892174208 00000100:00100000:1.0:1788802343.822437:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892174464 00000100:00100000:1.0:1788802343.822440:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892174464 00000100:00100000:1.0:1788802343.822466:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788802343.822473:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892174208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802343.822507:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892174208:12345-0@lo:400:kworker.0 Request processed in 35us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802343.822513:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788802343.822526:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788802343.822532:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892174464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802343.822571:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892174464:12345-0@lo:400:kworker.0 Request processed in 39us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802343.822577:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788802343.822602:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788802343.822606:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802343.822725:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892173824 00000100:00100000:0.0:1788802343.822731:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892173824 00000100:00100000:0.0:1788802343.822766:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788802343.822773:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892173824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802343.822813:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892173824:12345-0@lo:400:kworker.0 Request processed in 41us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802343.822819:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788802343.822908:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892174208:0@lo:400:kworker.0 00000100:00100000:0.0:1788802343.822936:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892174080:0@lo:400:kworker.0 00000100:00100000:0.0:1788802343.822987:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892173952:0@lo:400:kworker.0 00000100:00100000:0.0:1788802343.823012:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892174464:0@lo:400:kworker.0 00000100:00100000:0.0:1788802343.823022:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892173824:0@lo:400:kworker.0 00000100:00100000:0.0:1788802343.823031:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d08c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892174336:0@lo:400:kworker.0 00000100:00080000:1.0:1788802343.824703:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788802344.012552:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802344.332534:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802344.332568:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892174592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802344.332671:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802344.332881:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892174592 00000100:00100000:1.0:1788802344.332893:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892174592 00000100:00100000:1.0:1788802344.332961:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788802344.332972:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892174592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802344.333039:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802344.333575:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892174592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 604us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802344.333585:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788802344.333903:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3ee2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892174592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788802345.036829:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802345.313180:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802345.313639:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872268800 00000100:00100000:0.0:1788802345.313656:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872268800 00000100:00100000:0.0:1788802345.313760:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00100000:0.0:1788802345.313775:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+18:12327:x1875694872268800:12345-192.168.201.57@tcp:35:umount.0 00000100:00100000:0.0:1788802345.315006:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:12327:x1875694872268800:12345-192.168.201.57@tcp:35:umount.0 Request processed in 1228us (1839us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788802345.315031:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 66 00000100:00080000:1.0:1788802345.316587:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802345.324962:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802345.334569:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872269056 00000100:00100000:3.0:1788802345.334591:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872269056 00000100:00100000:3.0:1788802345.334696:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:3.0:1788802345.334710:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+19:12327:x1875694872269056:12345-192.168.201.57@tcp:35:umount.0 00000100:00100000:3.0:1788802345.341149:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:12327:x1875694872269056:12345-192.168.201.57@tcp:35:umount.0 Request processed in 6421us (16199us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788802345.341175:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 67 00000100:00100000:2.0:1788802345.351608:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802345.351777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872269312 00000100:00100000:0.0:1788802345.351792:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872269312 00000100:00100000:0.0:1788802345.351871:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:0.0:1788802345.351884:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d030c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+20:12327:x1875694872269312:12345-192.168.201.57@tcp:35:umount.0 00000100:00100000:0.0:1788802345.352305:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d030c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:12327:x1875694872269312:12345-192.168.201.57@tcp:35:umount.0 Request processed in 422us (712us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788802345.352315:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 68 00000100:00100000:2.0:1788802345.366155:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802345.366718:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872269568 00000100:00100000:3.0:1788802345.366744:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872269568 00000100:00100000:3.0:1788802345.366816:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:3.0:1788802345.366829:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+21:12327:x1875694872269568:12345-192.168.201.57@tcp:35:umount.0 00000100:00100000:2.0:1788802345.369764:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:12327:x1875694872269568:12345-192.168.201.57@tcp:35:umount.0 Request processed in 2908us (3596us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788802345.369786:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 69 00000100:00100000:1.0:1788802345.393812:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802345.393868:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802345.393899:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802345.394067:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802345.394130:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872269696 00000100:00100000:1.0:1788802345.394146:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872269696 00000100:00100000:3.0:1788802345.394444:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872269952 00000100:00100000:3.0:1788802345.394463:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872269952 00000100:00100000:3.0:1788802345.394547:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872269824 00000100:00100000:3.0:1788802345.394551:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872269824 00000100:00100000:3.0:1788802345.394576:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788802345.394588:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+15:2357:x1875694872269952:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802345.394610:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802345.394645:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3a0f3800/0x6ecba1490fc9bfe5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec71 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802345.394668:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802345.394743:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+14:2357:x1875694872269952:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 156us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802345.394752:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788802345.394772:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:3.0:1788802345.394779:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+13:2357:x1875694872269824:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802345.394788:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802345.394797:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3f95e200/0x6ecba1490fc9bd37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeb6e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802345.394807:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802345.394824:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+12:2357:x1875694872269824:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 46us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802345.394830:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:3.0:1788802345.394978:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872270336 00000100:00100000:3.0:1788802345.394983:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872270336 00000100:00100000:3.0:1788802345.395045:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 72 00000100:00100000:3.0:1788802345.395054:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2356:x1875694872270336:12345-192.168.201.57@tcp:9:umount.0 00000020:00000080:3.0:1788802345.395114:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9c311 00000020:00010000:3.0:1788802345.395125:0:6688:0:(genops.c:1920:obd_stale_export_put()) Put export ffff910d08aa7800: total 0 00000100:00080000:3.0:1788802345.395132:0:6688:0:(import.c:65:import_set_state_nolock()) ffff910d08aa6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788802345.395195:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788802345.395549:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2356:x1875694872270336:12345-192.168.201.57@tcp:9:umount.0 Request processed in 494us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802345.395557:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 72 00000020:00010000:3.0:1788802345.395593:0:6703:0:(genops.c:1906:obd_stale_export_get()) Get export ffff910d08aa7800: total 0 00010000:00010000:3.0:1788802345.395615:0:6703:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff910d08aa7800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788802345.395671:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021fc9771/0x6ecba1490fc9c6ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee46 expref: 4 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802345.395712:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0276843/0x6ecba1490fc9cd3d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf00d expref: 3 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802345.395728:0:6703:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff910d08aa7800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788802345.395740:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802345.395743:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802345.395744:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788802345.395760:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788802345.396602:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:1.0:1788802345.396618:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f34e9515-dc55-4812-97ce-617e4dd802db+11:2357:x1875694872269696:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802345.396639:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802345.396656:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f0600/0x6ecba1490fc9bdd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeba6 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.396690:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802345.396754:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f34e9515-dc55-4812-97ce-617e4dd802db+10:2357:x1875694872269696:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 139us (2959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802345.396763:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:3.0:1788802345.420652:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802345.420900:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872270464 00000100:00100000:0.0:1788802345.420918:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872270464 00000100:00100000:0.0:1788802345.421044:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:0.0:1788802345.421058:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+5:2356:x1875694872270464:12345-192.168.201.57@tcp:9:umount.0 00000020:00000080:0.0:1788802345.421099:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9c0a9 00000100:00080000:0.0:1788802345.421127:0:6687:0:(import.c:65:import_set_state_nolock()) ffff910d1d3ad800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788802345.421190:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788802345.421590:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+2:2356:x1875694872270464:12345-192.168.201.57@tcp:9:umount.0 Request processed in 534us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802345.421601:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 73 00010000:00010000:2.0:1788802345.421700:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788802345.421981:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788802345.452768:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802345.453649:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872271488 00000100:00100000:0.0:1788802345.453666:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872271488 00000100:00100000:0.0:1788802345.453761:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 239 00000100:00100000:0.0:1788802345.453774:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+22:2356:x1875694872271488:12345-192.168.201.57@tcp:39:umount.0 00000020:00000080:0.0:1788802345.453825:0:5843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bd45 00000020:00010000:0.0:1788802345.453849:0:5843:0:(genops.c:1920:obd_stale_export_put()) Put export ffff910d3a677800: total 0 00000100:00080000:0.0:1788802345.453856:0:5843:0:(import.c:65:import_set_state_nolock()) ffff910d21bf0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788802345.453897:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1788802345.455224:0:5830:0:(genops.c:1906:obd_stale_export_get()) Get export ffff910d3a677800: total 0 00010000:00010000:1.0:1788802345.455314:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff910d3a677800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788802345.455362:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802345.455368:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788802345.455383:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8000/0x6ecba1490fc9c36c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826eded6d expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455408:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910d05184d00) 00010000:00010000:1.0:1788802345.455411:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788802345.455416:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2200/0x6ecba1490fc9c00f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec7f expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455440:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802345.455443:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802345.455447:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1600/0x6ecba1490fc9ccfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edeff8 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455462:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d03b55b00) 00010000:00010000:1.0:1788802345.455465:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788802345.455470:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f400/0x6ecba1490fc9c701 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee5b expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455693:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802345.455697:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788802345.455701:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9cd28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf006 expref: 17 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455715:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802345.455718:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788802345.455722:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f200/0x6ecba1490fc9c58e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826ededf9 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455748:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:1.0:1788802345.455751:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788802345.455756:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9200/0x6ecba1490fc9c9fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edef34 expref: 15 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455770:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff910d2166a900) 00010000:00010000:1.0:1788802345.455773:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788802345.455776:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95f800/0x6ecba1490fc9c07f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec9b expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455794:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff910d05184600) 00010000:00010000:1.0:1788802345.455797:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788802345.455801:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1000/0x6ecba1490fc9cc1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edefc0 expref: 13 pid: 9415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455817:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff910d02db8900) 00010000:00010000:1.0:1788802345.455820:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788802345.455833:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9c71d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee62 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455853:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d2166a600) 00010000:00010000:1.0:1788802345.455856:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802345.455860:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95e000/0x6ecba1490fc9c02b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec86 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455877:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802345.455879:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788802345.455883:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9c698 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee3f expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455896:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff910d02e21200) 00010000:00010000:1.0:1788802345.455898:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802345.455901:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3f95fc00/0x6ecba1490fc9c66e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edee31 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802345.455916:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff910d3a677800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788802345.455933:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802345.455935:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802345.455938:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802345.456720:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df790e2a-6b5b-4b00-92e8-29e1cf7bde69+7:2356:x1875694872271488:12345-192.168.201.57@tcp:39:umount.0 Request processed in 2938us (3960us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788802345.456901:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 239 00000001:00100000:2.0:1788802345.956470:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000020:00000080:2.0:1788802345.956486:0:7635:0:(genops.c:885:class_export_put()) final put ffff910d08aa7800/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000020:00000080:2.0:1788802345.956556:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d08aa7800/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 for lustre-OST0001 00000020:00000080:2.0:1788802345.956657:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d08aa6000 for lustre-OST0001 00000001:00100000:0.0:1788802345.979401:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000001:00080000:0.0:1788802345.979428:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788802345.979455:0:5865:0:(genops.c:885:class_export_put()) final put ffff910d3a677800/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000020:00000080:2.0:1788802345.979661:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3a677800/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 for lustre-MDT0000 00000020:00000080:2.0:1788802345.979749:0:1386:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d21bf0800 for lustre-MDT0000 00010000:00010000:3.0:1788802346.060462:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802346.380651:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892174720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802346.380765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802346.380892:0:10279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892174720 00000100:00100000:2.0:1788802346.380906:0:10279:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892174720 00000100:00100000:2.0:1788802346.381017:0:10279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788802346.381029:0:10279:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892174720:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788802346.381111:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788802346.381313:0:10279:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802346.381377:0:10279:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892174720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 350us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802346.381386:0:10279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788802346.383856:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892174720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802346.482528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802346.483042:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802346.484144:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872271744 00000100:00100000:0.0:1788802346.484164:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872271744 00000100:00100000:0.0:1788802346.484353:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 176 00000100:00100000:0.0:1788802346.484369:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+6:2360:x1875694872271744:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802346.484477:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d5134f2-023b-4d13-91da-559e8a611b5e+6:2360:x1875694872271744:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 113us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802346.484485:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 176 00000100:00080000:3.0:1788802346.484915:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802346.486601:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872271616 00000100:00100000:2.0:1788802346.486623:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872271616 00000100:00100000:2.0:1788802346.486764:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 306 00000100:00100000:2.0:1788802346.486777:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872271616:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802346.486890:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872271616:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 115us (4378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802346.486899:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 306 00010000:00010000:2.0:1788802347.085395:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802347.089057:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802347.089105:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802347.089143:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802347.089176:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872271872 00000100:00100000:3.0:1788802347.089186:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872271872 00000100:00100000:2.0:1788802347.089264:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872272128 00000100:00100000:2.0:1788802347.089269:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872272128 00000100:00100000:3.0:1788802347.089278:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872272000 00000100:00100000:3.0:1788802347.089280:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872272000 00000100:00100000:2.0:1788802347.089294:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:2.0:1788802347.089305:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f34e9515-dc55-4812-97ce-617e4dd802db+12:2360:x1875694872271872:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802347.089321:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802347.089354:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01681e00/0x6ecba1490fc9be17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebbb expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802347.089374:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802347.089427:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f34e9515-dc55-4812-97ce-617e4dd802db+11:2360:x1875694872271872:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 124us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802347.089808:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:3.0:1788802347.089821:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+11:2360:x1875694872272128:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802347.090457:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802347.090474:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3eee8200/0x6ecba1490fc9bfde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edec6a expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802347.090487:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802347.090532:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+10:2360:x1875694872272128:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 710us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802347.090540:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:3.0:1788802347.090563:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:3.0:1788802347.090584:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+9:2360:x1875694872272000:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802347.090592:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802347.090602:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01681400/0x6ecba1490fc9be1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebe5 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802347.090611:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802347.090628:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f34e9515-dc55-4812-97ce-617e4dd802db+8:2360:x1875694872272000:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 59us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802347.090635:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:2.0:1788802347.095394:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:3.0:1788802347.097965:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802347.098094:0:9415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872272384 00000100:00100000:2.0:1788802347.098106:0:9415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872272384 00000100:00100000:2.0:1788802347.098223:0:9415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 240 00000100:00100000:2.0:1788802347.098234:0:9415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+6:2356:x1875694872272384:12345-192.168.201.57@tcp:39:umount.0 00000020:00000080:2.0:1788802347.098316:0:9415:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9be2c 00000020:00010000:2.0:1788802347.098325:0:9415:0:(genops.c:1920:obd_stale_export_put()) Put export ffff910d08d99800: total 0 00000100:00080000:2.0:1788802347.098330:0:9415:0:(import.c:65:import_set_state_nolock()) ffff910d08d9a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788802347.098351:0:9415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788802347.098770:0:9415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d5134f2-023b-4d13-91da-559e8a611b5e+5:2356:x1875694872272384:12345-192.168.201.57@tcp:39:umount.0 Request processed in 537us (824us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788802347.098779:0:9415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 240 00000020:00010000:1.0:1788802347.099014:0:5830:0:(genops.c:1906:obd_stale_export_get()) Get export ffff910d08d99800: total 0 00010000:00010000:1.0:1788802347.099019:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802347.099063:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff910d08d99800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788802347.099098:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d03b55b00) 00010000:00010000:1.0:1788802347.099102:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788802347.099111:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9c00/0x6ecba1490fc9cd4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf014 expref: 4 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802347.099155:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff910d08d99800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788802347.099167:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802347.099168:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802347.099170:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802347.118551:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802347.118887:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872272640 00000100:00100000:2.0:1788802347.118897:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872272640 00000100:00100000:2.0:1788802347.119009:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 307 00000100:00100000:2.0:1788802347.119020:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+7:2356:x1875694872272640:12345-192.168.201.57@tcp:251:umount.0 00000020:00000080:2.0:1788802347.119067:0:5836:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bd22 00000020:00010000:2.0:1788802347.119075:0:5836:0:(genops.c:1920:obd_stale_export_put()) Put export ffff910d21bf3800: total 0 00000100:00080000:2.0:1788802347.119080:0:5836:0:(import.c:65:import_set_state_nolock()) ffff910d21bf5800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788802347.119161:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08de8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f34e9515-dc55-4812-97ce-617e4dd802db+3:2356:x1875694872272640:12345-192.168.201.57@tcp:251:umount.0 Request processed in 143us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802347.119169:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 307 00000020:00010000:3.0:1788802347.119676:0:6703:0:(genops.c:1906:obd_stale_export_get()) Get export ffff910d21bf3800: total 0 00010000:00010000:3.0:1788802347.119724:0:6703:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff910d21bf3800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788802347.119759:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f1e00/0x6ecba1490fc9bdd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edebad expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802347.119776:0:6703:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff910d21bf3800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788802347.119786:0:6703:0:(genops.c:885:class_export_put()) final put ffff910d21bf3800/f34e9515-dc55-4812-97ce-617e4dd802db 00010000:00010000:3.0:1788802347.119807:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802347.119809:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802347.119812:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788802347.119860:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d21bf3800/f34e9515-dc55-4812-97ce-617e4dd802db for MGS 00000020:00000080:1.0:1788802347.119916:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d21bf5800 for MGS 00010000:00010000:0.0:1788802348.112918:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788802348.860756:0:12960:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000040:00080000:1.0:1788802348.878429:0:11677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788802348.878439:0:11677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788802348.878867:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788802348.878876:0:11677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:1.0:1788802348.886037:0:12960:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788802348.886082:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.886097:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.886104:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.886110:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.886136:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788802348.886141:0:12960:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788802348.886257:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802348.886264:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.886271:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d00030200 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:2.0:1788802348.886275:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.886283:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788802348.886290:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802348.886295:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788802348.886298:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788802348.886300:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788802348.886337:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.886345:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788802348.886370:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.886377:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d00030200/0x6ecba1490fc9bda7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bdae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.886391:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802348.886392:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802348.886394:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802348.886412:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892174848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802348.886500:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802348.886586:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892174848 00000100:00100000:2.0:1788802348.886593:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892174848 00000100:00100000:2.0:1788802348.886644:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788802348.886654:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+19:3313:x1875694892174848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788802348.886669:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802348.886685:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d00031400/0x6ecba1490fc9bdae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bda7 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.886698:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802348.886734:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:3313:x1875694892174848:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802348.886741:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788802348.886784:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892174848:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788802348.887040:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788802348.887045:0:12960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788802348.887052:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788802348.887080:0:12960:0:(import.c:65:import_set_state_nolock()) ffff910d33884000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788802348.890364:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875694892174976:0@lo:39:umount.0 00000100:00100000:2.0:1788802348.890456:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802348.891324:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892174976 00000100:00100000:1.0:1788802348.891335:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892174976 00000100:00100000:1.0:1788802348.891395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788802348.891405:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875694892174976:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788802348.891441:0:5844:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bb31 00000100:00080000:1.0:1788802348.891452:0:5844:0:(import.c:65:import_set_state_nolock()) ffff910d3479c800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788802348.891537:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1875694892174976:12345-0@lo:39:umount.0 Request processed in 134us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802348.891544:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1788802348.891553:0:5844:0:(genops.c:885:class_export_put()) final put ffff910d3479e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788802348.891579:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3479e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788802348.891618:0:1386:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d3479c800 for lustre-MDT0000 00000100:00080000:2.0:1788802348.892322:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d33884000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788802348.892378:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875694892174976:0@lo:39:umount.0 00010000:00010000:2.0:1788802348.896532:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788802348.898019:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788802348.898027:0:12960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788802348.898036:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788802348.900044:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.900064:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.900072:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.900078:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.900138:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788802348.900160:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.900167:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.900173:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.900180:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.904672:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788802348.904686:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.904698:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ea00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802348.904702:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.904715:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802348.904723:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802348.904729:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788802348.904732:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788802348.904781:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.904788:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802348.904824:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.904832:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3f95ea00/0x6ecba1490fc9bdb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bdbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.904849:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802348.904853:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802348.904985:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892175104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802348.905058:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802348.905125:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892175104 00000100:00100000:2.0:1788802348.905133:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892175104 00000100:00100000:2.0:1788802348.905183:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788802348.905193:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0831bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+18:3314:x1875694892175104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788802348.905207:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802348.905229:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f0800/0x6ecba1490fc9bdbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bdb5 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.905262:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802348.905298:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0831bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:3314:x1875694892175104:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802348.905305:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788802348.905370:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892175104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788802348.905478:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d029d6a00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802348.905481:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.905488:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802348.905493:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802348.905498:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788802348.905500:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1788802348.905515:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.905520:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802348.905549:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.905556:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802348.905558:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802348.905560:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802348.905600:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802348.905611:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892175232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788802348.905644:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802348.905739:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892175232 00000100:00100000:0.0:1788802348.905744:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892175232 00000100:00100000:0.0:1788802348.905781:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788802348.905788:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+17:3312:x1875694892175232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788802348.905797:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802348.905805:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d029d6600/0x6ecba1490fc9bce3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bcdc expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.905830:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802348.905871:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3312:x1875694892175232:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802348.905984:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892175232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788802348.906056:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788802348.908292:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788802348.908306:0:12960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d029d6a00/0x6ecba1490fc9bcdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802348.908328:0:12960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788802348.908340:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.908347:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.908354:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.908361:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.910341:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802348.910356:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.910367:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e400 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:2.0:1788802348.910371:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.910381:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788802348.910388:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802348.910395:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788802348.910397:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788802348.910438:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.910445:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788802348.910509:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892175360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788802348.910600:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788802348.910679:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.910700:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802348.910701:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802348.910703:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802348.910750:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892175360 00000100:00100000:0.0:1788802348.910760:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892175360 00000100:00100000:0.0:1788802348.910818:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788802348.910828:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3312:x1875694892175360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788802348.910842:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802348.910856:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3a0f2c00/0x6ecba1490fc9bfd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bfd0 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802348.910884:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802348.913101:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788802348.913117:0:12960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3f95e400/0x6ecba1490fc9bfd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bfd7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802348.913155:0:12960:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788802348.913170:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.913178:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.913184:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.913190:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802348.913210:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788802348.913213:0:12960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788802348.913216:0:12960:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788802348.913271:0:12960:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788802348.913276:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788802348.913280:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788802348.913286:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788802348.913292:0:12960:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff910d3a674000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788802348.913297:0:12960:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff910d33f94800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788802348.913304:0:12960:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff910d08d99800 5d5134f2-023b-4d13-91da-559e8a611b5e 192.168.201.57@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788802348.913308:0:12960:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff910d11330000) has exports, disconnecting them 00000020:00080000:1.0:1788802348.913314:0:12960:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff910d3a674000), last request at 1788802343 00000020:00000080:1.0:1788802348.913321:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bca4 00000100:00080000:1.0:1788802348.913339:0:12960:0:(import.c:65:import_set_state_nolock()) ffff910d3a674800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788802348.913400:0:12960:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff910d3a674000): rc 0 00000020:00000080:1.0:1788802348.913403:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d3a674000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788802348.913413:0:12960:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff910d33f94800), last request at 1788802343 00000020:00000080:1.0:1788802348.913417:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bbd9 00000100:00080000:1.0:1788802348.913424:0:12960:0:(import.c:65:import_set_state_nolock()) ffff910d33f90000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788802348.913434:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3a674000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788802348.913478:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d3a674800 for lustre-MDT0000 00000020:00080000:1.0:1788802348.913494:0:12960:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff910d33f94800): rc 0 00000020:00000080:1.0:1788802348.913497:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d33f94800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788802348.913507:0:12960:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffafe641bb7ae0 00000020:00000080:1.0:1788802348.913519:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d33f94800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788802348.913547:0:1386:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d33f90000 for lustre-MDT0000 00000100:00080000:1.0:1788802348.913569:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788802348.913572:0:12960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788802348.913586:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788802348.913662:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788802348.913685:0:12960:0:(import.c:65:import_set_state_nolock()) ffff910d08369000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788802348.913700:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788802348.913702:0:12960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788802348.913712:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788802348.913778:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788802348.913785:0:12960:0:(import.c:65:import_set_state_nolock()) ffff910d21bf7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788802348.913812:0:12960:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff910d11330000) has no exports 00010000:00010000:2.0:1788802348.913988:0:6703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802348.913996:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.914005:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f600 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:2.0:1788802348.914009:0:6703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.914018:0:6703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788802348.914025:0:6703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802348.914030:0:6703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788802348.914033:0:6703:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788802348.914035:0:6703:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788802348.914060:0:6703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.914067:0:6703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788802348.914085:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.914092:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9ba90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9ba97 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.914120:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802348.914122:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802348.914124:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802348.914141:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892175488:0@lo:9:umount.0 00000100:00100000:2.0:1788802348.914209:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802348.914262:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892175616:0@lo:9:umount.0 00000100:00100000:2.0:1788802348.914285:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802348.914323:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892175488 00000100:00100000:2.0:1788802348.914330:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892175488 00000100:00100000:2.0:1788802348.914376:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892175616 00000100:00100000:2.0:1788802348.914379:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892175616 00000100:00100000:2.0:1788802348.914403:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788802348.914411:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875694892175488:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788802348.914434:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bc26 00000100:00080000:2.0:1788802348.914440:0:6688:0:(import.c:65:import_set_state_nolock()) ffff910d0450b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788802348.914792:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788802348.915057:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ee2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3310:x1875694892175488:12345-0@lo:9:umount.0 Request processed in 645us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802348.915066:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788802348.915086:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788802348.915094:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d0453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875694892175616:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788802348.915108:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bd1b 00000100:00080000:2.0:1788802348.915114:0:6688:0:(import.c:65:import_set_state_nolock()) ffff910d21bf1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788802348.915129:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788802348.915410:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d0453ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3310:x1875694892175616:12345-0@lo:9:umount.0 Request processed in 316us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802348.915431:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788802348.915459:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802348.915464:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788802348.915479:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802348.915487:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788802348.915498:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892175744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802348.915530:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802348.915569:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892175744 00000100:00100000:2.0:1788802348.915575:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892175744 00000100:00100000:2.0:1788802348.915608:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788802348.915614:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dcb700dc-e7bb-457d-b553-2dc4634087c8+16:3314:x1875694892175744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788802348.915624:0:7624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802348.915639:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216e400/0x6ecba1490fc9ba97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9ba90 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802348.915657:0:7624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802348.915683:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dcb700dc-e7bb-457d-b553-2dc4634087c8+15:3314:x1875694892175744:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802348.915690:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788802348.915730:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dcb700dc-e7bb-457d-b553-2dc4634087c8:3314:1875694892175744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788802348.915749:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788802348.916438:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d08369000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788802348.916456:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788802348.916459:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788802348.916463:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892175488:0@lo:9:umount.0 00000100:00080000:2.0:1788802348.916476:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d21bf7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788802348.916483:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788802348.916494:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788802348.916498:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892175616:0@lo:9:umount.0 00000100:00100000:0.0:1788802348.918134:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dcb700dc-e7bb-457d-b553-2dc4634087c8+14:3312:x1875694892175360:12345-0@lo:103:ldlm_bl.0 Request processed in 7297us (7522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802348.918150:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788802348.918197:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802348.922995:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892175360:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788802348.935688:0:12960:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff910d11330000) has no exports 00000100:00100000:2.0:1788802348.942922:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892176000:0@lo:400:kworker.0 00000100:00100000:2.0:1788802348.943013:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802348.943085:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892176000 00000100:00100000:2.0:1788802348.943094:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892176000 00000100:00100000:2.0:1788802348.943138:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788802348.943146:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875694892176000:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788802348.943154:0:5843:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788802348.943194:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875694892176000:12345-0@lo:400:kworker.0 Request processed in 47us (182us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788802348.943201:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:2.0:1788802348.943261:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788802348.943266:0:3311:0:(import.c:65:import_set_state_nolock()) ffff910d3a670800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788802348.943270:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788802348.948055:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a6ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892175872:0@lo:400:kworker.0 00000100:00100000:3.0:1788802348.948142:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802348.954082:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892175872 00000100:00100000:1.0:1788802348.954100:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892175872 00000100:00100000:1.0:1788802348.954169:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788802348.954179:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1875694892175872:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788802348.954188:0:5844:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788802348.954318:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1875694892175872:12345-0@lo:400:kworker.0 Request processed in 139us (6176us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788802348.954326:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1788802348.954376:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788802348.954382:0:3314:0:(import.c:65:import_set_state_nolock()) ffff910d3efbc800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788802348.954386:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788802348.954392:0:3314:0:(import.c:65:import_set_state_nolock()) ffff910d3efbc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788802348.954397:0:3314:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 191 00000100:00080000:1.0:1788802348.954407:0:3314:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff910d3efbc800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788802348.954439:0:3314:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d3a18ca80 x1875694892176128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788802348.954472:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a6ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892175872:0@lo:400:kworker.0 00000100:00100000:3.0:1788802348.954614:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875694892176128:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788802348.954654:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802348.955180:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892176128 00000100:00100000:1.0:1788802348.955188:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892176128 00000100:00100000:1.0:1788802348.955224:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788802348.955230:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875694892176128:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788802348.955278:0:5843:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788802348.972206:0:3311:0:(import.c:65:import_set_state_nolock()) ffff910d3a670800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788802348.972217:0:3311:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 210 00000100:00080000:2.0:1788802348.972268:0:3311:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff910d3a670800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788802348.973574:0:3311:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910c02fa4000 x1875694892176256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788802348.973609:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875694892176000:0@lo:400:kworker.0 00000100:00100000:3.0:1788802348.973666:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875694892176256:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788802348.973738:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802348.985360:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892176256 00000100:00100000:2.0:1788802348.985380:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892176256 00000100:00100000:2.0:1788802348.985438:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788802348.985448:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875694892176256:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788802348.985468:0:5844:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788802348.985571:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875694892176256:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 122us (11831us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788802348.985579:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788802348.985662:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3a670800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788802348.985667:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788802348.985672:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875694892176256:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788802349.002797:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875694892176128:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 47553us (48129us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788802349.002828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1788802349.007152:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3efbc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788802349.007165:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788802349.007171:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875694892176128:0@lo:38:ptlrpcd_00_03.0 00000020:00000080:0.0:1788802349.043004:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9baeb 00000020:00000080:0.0:1788802349.043025:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d41983000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788802349.043047:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788802349.043111:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d41983000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788802349.043141:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788802349.043151:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788802349.043155:0:12960:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff910d347cb380) has no exports 00000020:00000080:2.0:1788802349.043976:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bae4 00000020:00000080:2.0:1788802349.043988:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d35894000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788802349.044053:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788802349.044062:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788802349.044064:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d347c1000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788802349.044067:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff910d347c1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788802349.044073:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788802349.044261:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d35894000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788802349.133028:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788802350.079973:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000020:00000080:3.0:1788802350.079986:0:6714:0:(genops.c:885:class_export_put()) final put ffff910d1d3ae800/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 00000001:00100000:3.0:1788802350.080021:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788802350.080024:0:6714:0:(genops.c:885:class_export_put()) final put ffff910d0450e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788802350.080112:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d1d3ae800/df790e2a-6b5b-4b00-92e8-29e1cf7bde69 for lustre-OST0000 00000020:00000080:1.0:1788802350.080169:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d0450e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788802350.080188:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d1d3ad800 for lustre-OST0000 00000020:00000080:1.0:1788802350.080194:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d0450b800 for lustre-OST0000 00010000:00010000:2.0:1788802350.156621:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788802351.032002:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d5134f2-023b-4d13-91da-559e8a611b5e 00000001:00080000:3.0:1788802351.032018:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788802351.032024:0:5865:0:(genops.c:885:class_export_put()) final put ffff910d08d99800/5d5134f2-023b-4d13-91da-559e8a611b5e 00000020:00000080:1.0:1788802351.032097:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d08d99800/5d5134f2-023b-4d13-91da-559e8a611b5e for lustre-MDT0000 00000020:00000080:1.0:1788802351.032159:0:1386:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d08d9a000 for lustre-MDT0000 00000020:01000000:3.0:1788802351.052585:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff910d3f23d840 - data ffff910d0d92f798/ffff910d3a62f000 00000020:01000000:3.0:1788802351.052750:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff910d11ac1060 - data ffff910d0d833510/ffff910d1d165000 00000001:00000004:3.0:1788802351.083815:0:12960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000001:00100000:2.0:1788802351.085329:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788802351.085340:0:7635:0:(genops.c:885:class_export_put()) final put ffff910d21bf2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788802351.085374:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d21bf2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788802351.085422:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d21bf1800 for lustre-OST0001 00010000:00010000:0.0:1788802351.182091:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788802351.189500:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788802351.189514:0:12960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788802351.189546:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788802351.189549:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788802351.190173:0:6865:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788802351.190179:0:6865:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788802351.190191:0:6865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788802351.191677:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788802351.191687:0:12960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788802351.191747:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788802351.191750:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788802351.194150:0:7940:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788802351.194158:0:7940:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788802351.194169:0:7940:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788802351.267387:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bab3 00000020:00000080:1.0:1788802351.267400:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d054ee000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788802351.267794:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d054ee000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788802351.275025:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bac8 00000020:00000080:1.0:1788802351.275044:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d347c2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788802351.275069:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788802351.275081:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788802351.275091:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788802351.275097:0:12960:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff910d113319c0) has no exports 00000020:00000080:3.0:1788802351.279163:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d347c2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788802351.279585:0:12960:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788802351.279599:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bd06 00000020:00000080:1.0:1788802351.279610:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d21bf2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788802351.279635:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788802351.279646:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788802351.279660:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788802351.279758:0:12960:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff910d3436cd40) has no exports 00000020:00000080:1.0:1788802351.279768:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bcff 00000020:00000080:1.0:1788802351.279773:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d21bf6000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788802351.280158:0:12960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788802351.280164:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788802351.280168:0:12960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788802351.280173:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788802351.280176:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788802351.280209:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788802351.280216:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788802351.280221:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bc1f 00000020:00000080:1.0:1788802351.280226:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d0450d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788802351.280230:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788802351.280233:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788802351.280323:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d21bf2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788802351.280332:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d21bf6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788802351.280337:0:1386:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d21bf7800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788802351.280342:0:1386:0:(genops.c:885:class_export_put()) final put ffff910d3efbb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788802351.280345:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3efbb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788802351.280360:0:1386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788802351.280432:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d0450d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788802351.281023:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788802351.281029:0:12960:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff910d07c40000) has no exports 00000020:00000080:1.0:1788802351.281045:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bc18 00000020:00000080:1.0:1788802351.281050:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d0836b000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788802351.281502:0:12960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788802351.281508:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788802351.281511:0:12960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788802351.281517:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788802351.281518:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788802351.282462:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d0836b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788802351.287368:0:1386:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d08369000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788802351.287448:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788802351.287464:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788802351.287471:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d3efbb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788802351.287475:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3efbb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788802351.287484:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788802351.287638:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788802351.287642:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788802351.287646:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d406be000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788802351.287648:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff910d406be000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788802351.287653:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788802351.287761:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bacf 00000020:00000080:1.0:1788802351.287768:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d347c2000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788802351.287815:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788802351.287820:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788802351.287825:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788802351.288004:0:12960:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff910d347c8000) has no exports 00000020:00000080:1.0:1788802351.288027:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788802351.288031:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788802351.288037:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bad6 00000020:00000080:1.0:1788802351.288041:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d347c1800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788802351.293110:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d347c2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788802351.293125:0:1386:0:(genops.c:885:class_export_put()) final put ffff910d347c4000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788802351.293128:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d347c4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788802351.293136:0:1386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788802351.294010:0:12960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910d054ea800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788802351.294018:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d054ea800 3 00000020:01000004:1.0:1788802351.294021:0:12960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff910d054ea800 from lustre-MDT0000 00000020:00000080:1.0:1788802351.294061:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788802351.294086:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788802351.294090:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d054ea000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788802351.294093:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff910d054ea000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788802351.294101:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788802351.294138:0:12960:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788802351.294143:0:12960:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788802351.294147:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788802351.294151:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788802351.294155:0:12960:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788802351.294162:0:12960:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff910d08215000 dcb700dc-e7bb-457d-b553-2dc4634087c8 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788802351.294168:0:12960:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff910d11334d40) has exports, disconnecting them 00000020:00080000:1.0:1788802351.294173:0:12960:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff910d08215000), last request at 1788802117 00000020:00000080:1.0:1788802351.294189:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9ba6d 00000020:00010000:1.0:1788802351.294197:0:12960:0:(genops.c:1920:obd_stale_export_put()) Put export ffff910d08215000: total 1 00000100:00080000:1.0:1788802351.294202:0:12960:0:(import.c:65:import_set_state_nolock()) ffff910d08213000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788802351.294339:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d347c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1788802351.294390:0:12960:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff910d08215000): rc 0 00000020:00080000:1.0:1788802351.294396:0:12960:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff910d11334d40) has no exports 00000100:00100000:3.0:1788802351.294532:0:5837:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff910d08db2200:5837] 2 exiting: rc = 0 00000020:00010000:0.0:1788802351.294828:0:6703:0:(genops.c:1906:obd_stale_export_get()) Get export ffff910d08215000: total 0 00010000:00010000:0.0:1788802351.294945:0:6703:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff910d08215000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788802351.294974:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01680c00/0x6ecba1490fc9bd76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bd6f expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802351.294993:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01681200/0x6ecba1490fc9bd92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bd8b expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802351.295003:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01680a00/0x6ecba1490fc9bda0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bd99 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802351.295013:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d00030600/0x6ecba1490fc9bd84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bd7d expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802351.295026:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f0000/0x6ecba1490fc9bfbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bfb4 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802351.295038:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f1800/0x6ecba1490fc9bb8c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bb85 expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802351.295053:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d01681800/0x6ecba1490fc9bdca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bdc3 expref: 3 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802351.295065:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3a0f2a00/0x6ecba1490fc9bfc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6ecba1490fc9bfc2 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802351.295075:0:6703:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff910d08215000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788802351.295086:0:6703:0:(genops.c:885:class_export_put()) final put ffff910d08215000/dcb700dc-e7bb-457d-b553-2dc4634087c8 00010000:00010000:0.0:1788802351.295103:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802351.295105:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802351.295107:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802351.295141:0:5834:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff910d08db3600:5834] 0 exiting: rc = 1 00000020:00000080:3.0:1788802351.295228:0:1386:0:(genops.c:844:class_export_destroy()) destroying export ffff910d08215000/dcb700dc-e7bb-457d-b553-2dc4634087c8 for MGS 00000020:00000080:3.0:1788802351.295288:0:1386:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d08213000 for MGS 00000100:00100000:1.0:1788802351.295374:0:5836:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff910d08209000:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1788802351.295473:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295480:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295486:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295493:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295499:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295506:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295512:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295517:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295523:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295529:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295535:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295541:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295548:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295553:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295558:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295564:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295571:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295578:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295584:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295600:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295607:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295612:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295619:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295624:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295629:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295635:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295640:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295645:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295650:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295656:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295661:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295681:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295686:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295691:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295697:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295703:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295708:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295713:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295718:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295723:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295728:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295733:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295738:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295744:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295748:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295754:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295760:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295765:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295770:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295775:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295780:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295785:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295790:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295795:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295808:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295814:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295819:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295824:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295829:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295924:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295929:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295935:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295941:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788802351.295946:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788802351.296372:0:12960:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788802351.296376:0:12960:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788802351.299067:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff910d3f23df60 - data ffff910d0d92fd80/ffff910d33ec1000 00000020:01000000:3.0:1788802351.299219:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff910d05619300 - data ffff910d0d82f870/ffff910d082abc00 00000020:00000080:3.0:1788802351.300749:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9ba58 00000020:00000080:3.0:1788802351.300761:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d11268000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788802351.300788:0:12960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910d054ea800 from MGS, refs=2 00000020:01000004:3.0:1788802351.300792:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d054ea800 2 00000020:01000004:3.0:1788802351.300795:0:12960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff910d054ea800 from MGS 00000020:00000080:3.0:1788802351.300821:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788802351.300829:0:12960:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788802351.300831:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d156d4800/MGS 00000020:00000080:3.0:1788802351.300834:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff910d156d4800/MGS for MGS 00000020:01000000:3.0:1788802351.300921:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788802351.300989:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788802351.300994:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788802351.301001:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788802351.301008:0:12960:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff910d33886000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788802351.301014:0:12960:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff910d418ab380) has exports, disconnecting them 00000020:00080000:3.0:1788802351.301019:0:12960:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff910d33886000), last request at 1788802119 00000020:00000080:3.0:1788802351.301023:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bb23 00000020:00080000:3.0:1788802351.301036:0:12960:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff910d33886000): rc 0 00000020:00000080:3.0:1788802351.301051:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d33886000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788802351.302544:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d11268000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788802351.302562:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d33886000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788802351.303501:0:12960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788802351.303508:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788802351.303513:0:12960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788802351.303519:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788802351.303735:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788802351.303745:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788802351.303754:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d054ea800 1 00000020:00000080:0.0:1788802351.303762:0:12960:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9ba4a 00000020:00000080:0.0:1788802351.303775:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d156d1800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788802351.303780:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788802351.303785:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788802351.303790:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788802351.303794:0:12960:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff910d11333380) has no exports 00000020:00000080:1.0:1788802351.306118:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d33884000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788802351.306136:0:38:0:(genops.c:885:class_export_put()) final put ffff910d33885800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788802351.306140:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d33885800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788802351.306148:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788802351.306209:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff910d156d1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788802351.399371:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788802351.399388:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788802351.399395:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d102eb800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788802351.399400:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff910d102eb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788802351.399411:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788802351.399531:0:12960:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff910d054ec800 00000020:01000000:1.0:1788802351.399556:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788802351.399571:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788802351.399577:0:12960:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788802351.399581:0:12960:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff910d10d5cd40) has no exports 00000100:00100000:1.0:1788802351.399662:0:5843:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff910d10d57e00:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1788802351.402795:0:5844:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff910d10d56600:5844] 2 exiting: rc = 0 00000100:00100000:2.0:1788802351.402943:0:5842:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff910d10d57c00:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1788802351.404616:0:9415:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff910d34445e00:9415] 3 exiting: rc = 0 00000100:00100000:1.0:1788802351.405048:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405057:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405063:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405069:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405075:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405080:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405086:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405091:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405099:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405104:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405110:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405115:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405121:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405126:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405132:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405148:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405154:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405161:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405167:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405172:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405177:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405183:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405189:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405195:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405201:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405206:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405212:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405217:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405222:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405227:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405233:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405273:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405278:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405284:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405290:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405296:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405301:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405307:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405313:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405319:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405325:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405331:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405338:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405344:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405349:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405354:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405360:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405366:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405371:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405376:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405381:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405387:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405392:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405397:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405403:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405408:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405413:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405418:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405424:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405430:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405435:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405441:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405446:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.405452:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788802351.410578:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff910d10d57000:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1788802351.411170:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff910d30e97c00:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1788802351.411304:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411313:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411332:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411339:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411345:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411350:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411357:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411364:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411370:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411377:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411382:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411388:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411395:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411400:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411405:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411410:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411416:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411421:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411426:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411431:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411435:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411440:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411445:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411451:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411456:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411461:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411472:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411477:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411483:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411489:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411495:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411500:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411505:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411509:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411514:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411519:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411524:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411537:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411542:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411547:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411552:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411557:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411562:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411567:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411573:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411578:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411583:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411589:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411594:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411599:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411605:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411610:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411615:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411620:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411625:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411630:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411636:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411642:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411647:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411652:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411658:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411663:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411668:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.411675:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412117:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff910d07e76600:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1788802351.412188:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff910d07e77e00:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1788802351.412273:0:12359:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff910d3f3cbc00:12359] 2 exiting: rc = 0 00000100:00100000:1.0:1788802351.412323:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412329:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412336:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412350:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412357:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412372:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412378:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412384:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412389:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412397:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412404:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412411:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412418:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412425:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412430:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412450:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412457:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412463:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412469:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412476:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412482:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412488:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412493:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412499:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412504:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412510:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412517:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412535:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412543:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412550:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412556:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412562:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412569:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412575:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412581:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412587:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412594:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412601:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412608:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412627:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412646:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412652:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412659:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412666:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412672:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412679:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412687:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412694:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412700:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412707:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412714:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412736:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412744:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412750:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412757:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412763:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412769:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412775:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412782:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412788:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412794:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412800:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412807:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.412823:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802351.432634:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff910d21b78800:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1788802351.432998:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff910d21b78600:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1788802351.433639:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433647:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433652:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433657:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433663:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433668:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433674:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433679:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433684:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433689:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433710:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433715:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433721:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433726:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433731:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433736:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433742:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433747:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433752:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433757:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433762:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433767:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433771:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433776:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433780:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433785:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433790:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433794:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433799:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433804:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433808:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433814:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433819:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.433824:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434565:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434581:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434587:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434593:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434598:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434602:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434608:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434613:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434618:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434623:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434628:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434644:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434649:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434654:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434660:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434665:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434671:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434676:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434682:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434687:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434693:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434699:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434704:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434709:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434717:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434722:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434727:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434732:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434738:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.434743:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435176:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff910d21b79200:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1788802351.435346:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff910d21b79e00:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1788802351.435712:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435718:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435724:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435729:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435734:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435739:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435744:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435749:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435754:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435759:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435764:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435768:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435773:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435777:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435782:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435801:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435806:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435811:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435816:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435821:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435883:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435891:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435896:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435912:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435919:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435923:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435928:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435933:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435937:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435941:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435946:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435950:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435955:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435959:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435964:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435968:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435972:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435977:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435982:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435987:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435992:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.435997:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436002:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436006:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436011:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436015:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436020:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436026:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436031:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436036:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436050:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436055:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436059:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436063:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436069:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436074:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436079:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436084:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436089:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436094:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436099:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436103:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436108:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.436114:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802351.436788:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff910d21b78a00:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1788802351.437176:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff910d21b78000:5854] 1 exiting: rc = 0 00000100:00100000:1.0:1788802351.437230:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437258:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437265:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437270:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437276:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437282:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437287:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437292:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437297:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437302:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437307:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437312:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437316:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437320:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437324:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437329:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437333:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437338:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437343:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437348:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437364:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437368:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437373:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437377:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437382:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437386:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437391:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437395:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437399:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437403:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437408:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437412:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437417:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437422:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437427:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437432:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437437:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437441:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437446:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437450:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437455:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437460:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437464:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437469:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437474:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437480:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437485:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437490:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437495:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437500:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437505:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437509:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437514:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437519:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437524:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437536:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437542:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437547:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437552:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437557:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437563:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437568:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437573:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.437577:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.438169:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff910d10cacc00:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1788802351.438403:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff910d10cac800:5855] 0 exiting: rc = 1 00000100:00100000:2.0:1788802351.438914:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff910d10c76c00:5857] 2 exiting: rc = 0 00000100:00100000:1.0:1788802351.439207:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439216:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439221:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439227:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439232:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439259:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439275:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439282:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439289:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439295:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439301:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439307:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439313:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439319:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439325:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439332:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439338:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439343:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439349:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439354:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439360:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439366:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439372:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439390:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439398:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439413:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439418:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439424:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439430:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439435:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439440:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439446:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439451:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439457:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439463:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439468:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439473:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439478:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439484:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439490:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439496:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439501:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439507:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439513:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439519:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439524:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439530:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439550:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439558:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439564:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439569:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439575:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439581:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439586:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439591:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439597:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439602:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439607:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439614:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439620:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439633:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439639:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439644:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788802351.439651:0:12960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788802351.444068:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788802351.444082:0:12960:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788802351.444089:0:12960:0:(genops.c:885:class_export_put()) final put ffff910d054eb000/MDS_uuid 00000020:00000080:0.0:1788802351.444094:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff910d054eb000/MDS_uuid for MDS 00000020:01000000:0.0:1788802351.444100:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788802351.444293:0:12960:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788802352.204518:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802353.229392:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802354.067022:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892176384:0@lo:400:kworker.0 00000400:00000100:2.0:1788802354.067217:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875694892176384 offset 0 length 224: 4 00000100:00080000:3.0:1788802354.067381:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788802354.067387:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788802354.067390:0:8:0:(import.c:65:import_set_state_nolock()) ffff910d3efbc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788802354.067396:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 401 00000100:00080000:3.0:1788802354.067401:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788802354.067411:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff910d3efbc800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788802354.067435:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910c02fa7b80 x1875694892176512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788802354.067453:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788802354.067457:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788802354.067459:0:8:0:(import.c:65:import_set_state_nolock()) ffff910d3a670800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788802354.067462:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 401 00000100:00080000:3.0:1788802354.067465:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788802354.067469:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff910d3a670800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788802354.067481:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910c02fa6d80 x1875694892176640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788802354.071223:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875694892176512:0@lo:38:kworker.0 00000400:00000100:3.0:1788802354.071292:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875694892176512 offset 0 length 520: 4 00000100:00100000:3.0:1788802354.071319:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875694892176640:0@lo:38:kworker.0 00000400:00000100:3.0:1788802354.071333:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875694892176640 offset 0 length 520: 4 00010000:00010000:0.0:1788802354.253585:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788802354.742501:0:13112:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788802354.757550:0:13112:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788802354.757608:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.757623:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.757631:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.757638:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.757715:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788802354.757722:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788802354.757748:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788802354.757760:0:13112:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff910c02fa7b80 x1875694892176512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788802369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802354.757778:0:13112:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788802354.757785:0:13112:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788802354.757803:0:13112:0:(import.c:65:import_set_state_nolock()) ffff910d3efbc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788802354.757808:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788802354.757812:0:13112:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff910c02fa7b80 x1875694892176512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788802369 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802354.757819:0:13112:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788802354.757822:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788802354.757973:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875694892176512:0@lo:38:kworker.0 00010000:00010000:2.0:1788802354.760548:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.760569:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.760577:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.760584:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802354.760680:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788802354.760688:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802354.760713:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ee00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802354.760717:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802354.760725:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802354.760732:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802354.760738:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788802354.760740:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788802354.760743:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788802354.760782:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802354.760801:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802354.760832:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802354.760840:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3f95ee00/0x6ecba1490fc9bd8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bd92 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802354.760863:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802354.760867:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802354.760872:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95fa00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802354.760875:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802354.760889:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802354.760895:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802354.760900:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788802354.760902:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788802354.760915:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802354.760921:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802354.760927:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802354.760935:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802354.760936:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802354.760938:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802354.760992:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892176768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788802354.761065:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802354.761130:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788802354.761136:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892176896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788802354.761159:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802354.761191:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892176768 00000100:00100000:3.0:1788802354.761198:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892176768 00000100:00100000:3.0:1788802354.761232:0:7624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892176896 00000100:00100000:3.0:1788802354.761267:0:7624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892176896 00000100:00100000:3.0:1788802354.761286:0:7624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788802354.761294:0:7624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1875694892176768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788802354.761300:0:7624:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788802354 with bad export cookie 7983652099613899373 00000100:00100000:0.0:1788802354.761917:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788802354.761925:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1875694892176896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788802354.761931:0:5826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788802354 with bad export cookie 7983652099613899373 00000100:00100000:0.0:1788802354.761997:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1875694892176896:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (837us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788802354.762004:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788802354.762047:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.157@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788802354.762052:0:3313:0:(import.c:65:import_set_state_nolock()) ffff910d0818c800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788802354.762055:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788802354.763944:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788802354.763960:0:13112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3f95fa00/0x6ecba1490fc9bd99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bda0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.763986:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.763995:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.764002:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.764010:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802354.764049:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788802354.764056:0:13112:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788802354.764076:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788802354.764110:0:13112:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788802354.764114:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788802354.764206:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788802354.764213:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788802354.764217:0:13112:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff910d10d58000) has no exports 00000020:00080000:2.0:1788802354.764267:0:13112:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff910d10d58000) has no exports 00010000:00010000:1.0:1788802354.764940:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802354.764951:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802354.764959:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee9600 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802354.764963:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802354.764971:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802354.764977:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802354.764983:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788802354.764985:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788802354.764988:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000000:2.0:1788802354.766358:0:13112:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff910d3f23d780 - data ffff910d2eff9bd0/ffff910d3a62f800 00000020:01000000:2.0:1788802354.766515:0:13112:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff910d18149300 - data ffff910d2ef00000/ffff910d1d04c400 00000100:00100000:3.0:1788802354.770082:0:7624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1875694892176768:12345-0@lo:103:ldlm_bl.0 Request processed in 8782us (9011us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788802354.770095:0:7624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1788802354.772384:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788802354.779379:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.157@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788802354.779398:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788802354.779410:0:3313:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff910c02fa5f80 x1875694892176384/t0(0) o400->MGC192.168.201.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788802370 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802354.779433:0:3313:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff910d10d3d500 x1875694892176768/t0(0) o103->MGC192.168.201.157@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788802370 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802354.779442:0:3313:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff910d10d3ed80 x1875694892176896/t0(0) o103->MGC192.168.201.157@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788802370 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788802354.779452:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788802354.779455:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788802354.779456:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788802354.779538:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dcb700dc-e7bb-457d-b553-2dc4634087c8:3312:1875694892176384:0@lo:400:kworker.0 00010000:00010000:1.0:1788802354.779953:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802354.779964:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802354.779992:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802354.780000:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3eee9600/0x6ecba1490fc9bfc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6ecba1490fc9bfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802354.780027:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802354.780029:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802354.780031:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802354.780101:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dcb700dc-e7bb-457d-b553-2dc4634087c8:0:1875694892177024:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788802354.780160:0:3313:0:(import.c:65:import_set_state_nolock()) ffff910d0818c800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788802354.780167:0:3313:0:(import.c:545:import_select_connection()) MGC192.168.201.157@tcp: connect to NID 0@lo last attempt 170 00000100:00080000:0.0:1788802354.780180:0:3313:0:(import.c:666:import_select_connection()) MGC192.168.201.157@tcp: import ffff910d0818c800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788802354.780198:0:3313:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d10d3d180 x1875694892177152/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788802354.780228:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892176768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788802354.780293:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dcb700dc-e7bb-457d-b553-2dc4634087c8:3313:1875694892176896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788802354.780394:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dcb700dc-e7bb-457d-b553-2dc4634087c8:3310:1875694892177152:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788802354.780445:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875694892177152 offset 0 length 520: 4 00100000:10000000:2.0:1788802354.789000:0:13112:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788802354.831548:0:13112:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bba8 00000020:00000080:1.0:1788802354.831562:0:13112:0:(genops.c:885:class_export_put()) final put ffff910d3efbc000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788802354.831586:0:13112:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910d1d17c800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788802354.831591:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d1d17c800 2 00000020:01000004:1.0:1788802354.831595:0:13112:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff910d1d17c800 from lustre-OST0000 00000020:00000080:1.0:1788802354.831621:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788802354.831635:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788802354.831638:0:13112:0:(genops.c:885:class_export_put()) final put ffff910d3efbd000/lustre-OST0000_UUID 00000020:00000080:1.0:1788802354.831641:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3efbd000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788802354.831649:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788802354.831689:0:13112:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788802354.831694:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788802354.831698:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788802354.831702:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788802354.831709:0:13112:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff910d406b9800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788802354.831715:0:13112:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff910d10d5b380) has exports, disconnecting them 00000020:00080000:1.0:1788802354.831719:0:13112:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff910d406b9800), last request at 1788802138 00000020:00000080:1.0:1788802354.831723:0:13112:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bbd2 00000020:00080000:1.0:1788802354.831731:0:13112:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff910d406b9800): rc 0 00000020:00000080:1.0:1788802354.831736:0:13112:0:(genops.c:885:class_export_put()) final put ffff910d406b9800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788802354.832587:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3efbc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788802354.832601:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d406b9800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788802354.838358:0:13112:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788802354.838366:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788802354.838371:0:13112:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788802354.838378:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788802354.838759:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788802354.838778:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788802354.838792:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d1d17c800 1 00000020:00000080:2.0:1788802354.838800:0:13112:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bb62 00000020:00000080:2.0:1788802354.838810:0:13112:0:(genops.c:885:class_export_put()) final put ffff910d21b04000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788802354.838970:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d3efbc800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788802354.838979:0:8:0:(genops.c:885:class_export_put()) final put ffff910d3efbf800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788802354.838981:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3efbf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788802354.838992:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788802354.839439:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788802354.839444:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788802354.839450:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788802354.839454:0:13112:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff910d10d599c0) has no exports 00000020:00000080:3.0:1788802354.840346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d21b04000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788802354.855399:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788802354.855416:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788802354.855422:0:13112:0:(genops.c:885:class_export_put()) final put ffff910d1d179000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788802354.855436:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff910d1d179000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788802354.855445:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788802354.855605:0:13112:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff910d1d178000 00000020:02000400:3.0:1788802354.855672:0:13112:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788802355.279876:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802356.300423:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802357.325963:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788802357.436081:0:13261:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788802357.452864:0:13261:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788802357.452950:0:13261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.452964:0:13261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.452971:0:13261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.452990:0:13261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.453022:0:13261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788802357.453028:0:13261:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788802357.453055:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788802357.453138:0:13261:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff910c02fa6d80 x1875694892176640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788802369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802357.453159:0:13261:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788802357.453166:0:13261:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788802357.453173:0:13261:0:(import.c:65:import_set_state_nolock()) ffff910d3a670800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788802357.453179:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788802357.453183:0:13261:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff910c02fa6d80 x1875694892176640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788802369 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802357.453189:0:13261:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788802357.453191:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:1.0:1788802357.453277:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802357.453285:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.453294:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95fe00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802357.453305:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.453315:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802357.453322:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802357.453328:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788802357.453331:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788802357.453333:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788802357.453345:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910d0818c800 00010000:00010000:1.0:1788802357.453349:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.453356:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3f95fe00/0x6ecba1490fc9bd6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6ecba1490fc9bd76 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.453368:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802357.453370:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802357.453372:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802357.453598:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875694892176640:0@lo:38:kworker.0 00010000:00010000:0.0:1788802357.457912:0:13261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.457929:0:13261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.457936:0:13261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.457942:0:13261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.457985:0:13261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788802357.457993:0:13261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.458001:0:13261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.458006:0:13261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.458012:0:13261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802357.458031:0:13261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788802357.458036:0:13261:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788802357.458060:0:13261:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1788802357.458273:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788802357.458281:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.458289:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e800 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802357.458292:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.458301:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802357.458315:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802357.458320:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788802357.458323:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788802357.458325:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788802357.458337:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910d0818c800 00010000:00010000:1.0:1788802357.458341:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.458348:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3f95e800/0x6ecba1490fc9bd7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6ecba1490fc9bd84 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.458359:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802357.458363:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.458368:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3a00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802357.458371:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.458377:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802357.458383:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802357.458388:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788802357.458390:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788802357.458397:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788802357.458405:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910d0818c800 00010000:00010000:1.0:1788802357.458408:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.458414:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3a0f3a00/0x6ecba1490fc9bfb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6ecba1490fc9bfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802357.458427:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802357.458429:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802357.458431:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802357.458597:0:6703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788802357.458856:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788802357.458864:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788802357.458872:0:13261:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788802357.458877:0:13261:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff910d10cb99c0) has no exports 00000020:00080000:0.0:1788802357.458904:0:13261:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff910d10cb99c0) has no exports 00000020:01000000:0.0:1788802357.462060:0:13261:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff910d34052ba0 - data ffff910d3f663d80/ffff910d343b7400 00000020:01000000:0.0:1788802357.462231:0:13261:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff910d1d229a20 - data ffff910d3f418000/ffff910d418e5400 00100000:10000000:3.0:1788802357.474300:0:13261:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788802357.509640:0:13261:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bc73 00000020:00000080:3.0:1788802357.509663:0:13261:0:(genops.c:885:class_export_put()) final put ffff910d3f8d5800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788802357.509686:0:13261:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910d0450e000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788802357.509689:0:13261:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d0450e000 2 00000020:01000004:3.0:1788802357.509693:0:13261:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff910d0450e000 from lustre-OST0001 00000020:00000080:2.0:1788802357.510001:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3f8d5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788802357.510045:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788802357.510054:0:13261:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788802357.510058:0:13261:0:(genops.c:885:class_export_put()) final put ffff910d3f8d1800/lustre-OST0001_UUID 00000020:00000080:3.0:1788802357.510061:0:13261:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3f8d1800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788802357.510067:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788802357.510172:0:13261:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import dcb700dc-e7bb-457d-b553-2dc4634087c8->MGS 00010000:00010000:3.0:1788802357.510191:0:13261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d206f1200/0x6ecba1490fc9bb85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bb8c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788802357.510205:0:13261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1200/0x6ecba1490fc9bb85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bb8c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802357.510213:0:13261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788802357.510216:0:13261:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788802357.510220:0:13261:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788802357.510269:0:13261:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910d0818c800 00010000:00010000:3.0:1788802357.510274:0:13261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d206f1200/0x6ecba1490fc9bb85 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6ecba1490fc9bb8c expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802357.510307:0:13261:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bdc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6ecba1490fc9bdca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788802357.510313:0:13261:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bdc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6ecba1490fc9bdca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802357.510318:0:13261:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788802357.510320:0:13261:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788802357.510322:0:13261:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788802357.510333:0:13261:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff910d0818c800 00010000:00010000:3.0:1788802357.510336:0:13261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d01681a00/0x6ecba1490fc9bdc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6ecba1490fc9bdca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788802357.510353:0:13261:0:(import.c:65:import_set_state_nolock()) ffff910d0818c800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788802357.510358:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788802357.510361:0:13261:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788802357.510363:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788802357.510368:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788802357.510381:0:13261:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff910d10d3d180 x1875694892177152/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788802364 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788802357.510462:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788802357.510466:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1788802357.510545:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dcb700dc-e7bb-457d-b553-2dc4634087c8:3310:1875694892177152:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1788802357.510846:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788802357.510855:0:13261:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9ba66 00000020:00000080:3.0:1788802357.510860:0:13261:0:(genops.c:885:class_export_put()) final put ffff910d0818b000/dcb700dc-e7bb-457d-b553-2dc4634087c8 00000020:01000000:3.0:1788802357.510878:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.157@tcp (flags='') 00000020:00000080:3.0:1788802357.510884:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788802357.510890:0:13261:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.157@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788802357.510894:0:13261:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff910d10cbcd40) has no exports 00000020:00000080:2.0:1788802357.510944:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d0818b000/dcb700dc-e7bb-457d-b553-2dc4634087c8 for MGC192.168.201.157@tcp 10000000:01000000:0.0:1788802357.510998:0:5840:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788802357.511081:0:13261:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.157@tcp: client import never connected 00000100:00080000:3.0:1788802357.511089:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788802357.511091:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788802357.511093:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788802357.511094:0:13261:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788802357.511135:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788802357.511140:0:13261:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.157@tcp (uuid dcb700dc-e7bb-457d-b553-2dc4634087c8) 00000020:01000000:3.0:1788802357.511146:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788802357.511149:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788802357.511153:0:13261:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788802357.511158:0:13261:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff910d3f8d4800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788802357.511163:0:13261:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff910d418acd40) has exports, disconnecting them 00000020:00080000:3.0:1788802357.511167:0:13261:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff910d3f8d4800), last request at 1788802157 00000020:00000080:3.0:1788802357.511171:0:13261:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bc9d 00000020:00080000:3.0:1788802357.511181:0:13261:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff910d3f8d4800): rc 0 00000020:00000080:3.0:1788802357.511184:0:13261:0:(genops.c:885:class_export_put()) final put ffff910d3f8d4800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788802357.511573:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d0818c800 for MGC192.168.201.157@tcp 00000020:00000080:2.0:1788802357.511580:0:8:0:(genops.c:885:class_export_put()) final put ffff910d0818f800/dcb700dc-e7bb-457d-b553-2dc4634087c8 00000020:00000080:2.0:1788802357.511583:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d0818f800/dcb700dc-e7bb-457d-b553-2dc4634087c8 for MGC192.168.201.157@tcp 00000020:01000000:2.0:1788802357.511591:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.157@tcp (dcb700dc-e7bb-457d-b553-2dc4634087c8) 00000020:00000080:2.0:1788802357.511851:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3f8d4800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788802357.512856:0:13261:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788802357.512865:0:13261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788802357.512869:0:13261:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788802357.512875:0:13261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788802357.512967:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff910d3a670800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788802357.513043:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788802357.513303:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788802357.513443:0:6703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788802357.513764:0:5824:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff910d113bc200:5824] 0 exiting: rc = 1 00000100:00100000:1.0:1788802357.514186:0:5825:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff910d113bce00:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1788802357.514363:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.514909:0:5826:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff910d113bd800:5826] 0 exiting: rc = 1 00000100:00100000:0.0:1788802357.514986:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff910d113bda00:5828] 2 exiting: rc = 0 00000100:00100000:0.0:1788802357.515400:0:7624:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff910d3f265a00:7624] 3 exiting: rc = 0 00000100:00100000:2.0:1788802357.516317:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff910d113bc600:5827] 1 exiting: rc = 0 00000100:00100000:0.0:1788802357.516437:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516446:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516453:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516459:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516464:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516470:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516477:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516483:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516489:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516494:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516500:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516506:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516512:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516518:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516524:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516530:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516536:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516541:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516546:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516552:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516557:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516562:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516568:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516573:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516578:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516583:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516588:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516593:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516598:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516603:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516608:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516613:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516617:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516631:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516635:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516640:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516881:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516887:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516892:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516898:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516903:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516909:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516915:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516920:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516925:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516930:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516935:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516940:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516945:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516953:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516958:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516963:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516968:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516973:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516977:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516982:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516987:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516991:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.516996:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.517001:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.517006:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.517011:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.517017:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.517022:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788802357.518002:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788802357.518012:0:13261:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788802357.518018:0:13261:0:(genops.c:885:class_export_put()) final put ffff910d3a672000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788802357.518022:0:13261:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3a672000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788802357.518036:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788802357.518077:0:13261:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d0450e000 1 00000020:00000080:0.0:1788802357.518082:0:13261:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9bc42 00000020:00000080:0.0:1788802357.518090:0:13261:0:(genops.c:885:class_export_put()) final put ffff910d3efbd800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788802357.518108:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788802357.518112:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788802357.518117:0:13261:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788802357.518121:0:13261:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff910d347c99c0) has no exports 00000020:00000080:2.0:1788802357.518199:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3efbd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788802357.536415:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788802357.536432:0:13261:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788802357.536438:0:13261:0:(genops.c:885:class_export_put()) final put ffff910d3efb9000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788802357.536443:0:13261:0:(genops.c:844:class_export_destroy()) destroying export ffff910d3efb9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788802357.536450:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788802357.536670:0:13261:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff910d3a5a6000 00000020:01000000:0.0:1788802357.536700:0:13261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788802357.536705:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788802357.536709:0:13261:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788802357.536713:0:13261:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff910d347ccd40) has no exports 00000020:00000080:0.0:1788802357.536982:0:13261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788802357.536990:0:13261:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788802357.536994:0:13261:0:(genops.c:885:class_export_put()) final put ffff910d21b00000/OSS_uuid 00000020:00000080:0.0:1788802357.536996:0:13261:0:(genops.c:844:class_export_destroy()) destroying export ffff910d21b00000/OSS_uuid for OSS 00000020:01000000:0.0:1788802357.537005:0:13261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788802357.537036:0:5838:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788802357.543266:0:8127:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff910d083dd200:8127] 3 exiting: rc = 0 00000100:00100000:2.0:1788802357.543818:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff910d08c37600:6687] 0 exiting: rc = 1 00000100:00100000:2.0:1788802357.543889:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff910d08c0d800:6690] 2 exiting: rc = 0 00000100:00100000:2.0:1788802357.544110:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff910d08c0d600:6688] 1 exiting: rc = 0 00000100:00100000:0.0:1788802357.544424:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544442:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544450:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544457:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544462:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544468:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544473:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544478:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544482:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544502:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544507:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544512:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544517:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544522:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544527:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544532:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544537:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544544:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544549:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544554:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544558:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544564:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544569:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544574:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544579:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544584:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544589:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544595:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544600:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544606:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544612:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544617:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544622:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544627:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544632:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544637:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544642:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544647:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544666:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544672:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544678:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544684:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544690:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544700:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.544716:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545040:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545049:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545055:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545060:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545066:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545071:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545076:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545081:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545086:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545091:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545097:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545102:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545107:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545113:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545118:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545124:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545129:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545133:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.545138:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788802357.546981:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff910d10d15c00:6692] 1 exiting: rc = 0 00000100:00100000:2.0:1788802357.547094:0:10279:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff910d3fc38e00:10279] 2 exiting: rc = 0 00000100:00100000:1.0:1788802357.547230:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff910d10d14600:6691] 0 exiting: rc = 1 00000100:00100000:0.0:1788802357.548003:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548017:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548023:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548029:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548035:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548040:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548045:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548051:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548057:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548064:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548069:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548075:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548081:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548086:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548092:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548113:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548119:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548123:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548129:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548134:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548140:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548146:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548151:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548157:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548163:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548171:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548178:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548190:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548197:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548202:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548207:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548212:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548219:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548230:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548355:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548363:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548368:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548373:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548378:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548631:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548651:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548657:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548662:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548667:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548673:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548678:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548683:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548689:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548694:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548700:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548714:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548719:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548861:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548869:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548874:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548880:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548885:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548890:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548896:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548901:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548906:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548912:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548917:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.548923:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788802357.551302:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff910d3a183c00:6694] 1 exiting: rc = 0 00000100:00100000:2.0:1788802357.551535:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff910d10d14a00:6693] 0 exiting: rc = 1 00000100:00100000:0.0:1788802357.552064:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff910d3a183e00:6695] 2 exiting: rc = 0 00000100:00100000:0.0:1788802357.552131:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552141:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552146:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552160:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552167:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552172:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552178:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552183:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552189:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552195:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552200:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552206:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552217:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552225:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552231:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552256:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552263:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552269:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552274:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552281:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552300:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552306:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552312:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552318:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552324:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552329:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552334:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552340:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552346:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552353:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552359:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552365:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552370:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552376:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552394:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552497:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552520:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552526:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552532:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552537:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552543:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552549:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552555:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552561:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552567:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552572:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552578:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552582:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552588:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552593:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552599:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552605:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552610:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552616:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552621:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552631:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552637:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552707:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552715:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552776:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552784:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552790:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552804:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.552810:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560019:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff910d3a182800:6697] 1 exiting: rc = 0 00000100:00100000:2.0:1788802357.560160:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff910d3a182c00:6696] 0 exiting: rc = 1 00000100:00100000:0.0:1788802357.560318:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560326:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560332:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560337:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560342:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560348:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560354:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560359:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560364:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560368:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560373:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560378:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560506:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560516:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560521:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560527:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560532:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560537:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560543:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560548:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560554:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560560:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560566:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560571:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560577:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560596:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560600:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560605:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560610:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560615:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560619:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560623:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560628:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560632:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560637:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560717:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560792:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560807:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560813:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560818:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560824:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560829:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560835:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560840:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560845:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560850:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560855:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560860:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560865:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560870:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560875:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560881:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560885:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560891:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560896:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560901:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560907:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560913:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560919:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560924:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560936:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560942:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560947:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.560952:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788802357.562786:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff910d3a183800:6698] 0 exiting: rc = 1 00000100:00100000:1.0:1788802357.563115:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff910d41994c00:6699] 1 exiting: rc = 0 00000100:00100000:0.0:1788802357.563882:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563891:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563896:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563902:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563910:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563916:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563922:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563929:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563935:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563943:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563949:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563954:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563974:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563981:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563986:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563992:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.563999:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564005:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564011:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564017:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564024:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564030:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564036:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564042:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564063:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564070:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564077:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564083:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564088:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564094:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564101:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564119:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564124:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564130:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564136:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564142:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564163:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564181:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564188:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564195:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564202:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564207:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564212:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564217:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564224:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564230:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564260:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564268:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564290:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564298:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564303:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564309:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564314:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564320:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564326:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564333:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564338:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564345:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564351:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564357:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564364:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564369:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564407:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788802357.564448:0:13261:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788802357.575713:0:13261:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788802374.638533:0:13872:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788802384.352811:0:14335:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788802384.352823:0:14335:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788802384.352964:0:14335:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff910d3f90d800 00000020:01000004:1.0:1788802384.352987:0:14335:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788802384.352997:0:14335:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788802384.353017:0:14335:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff910d418ab380) 00000020:00000080:1.0:1788802384.353034:0:14335:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788802384.370902:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788802384.375905:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788802384.376409:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788802384.376511:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1788802384.376626:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1788802384.376824:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788802384.376899:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1788802384.377032:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788802384.377120:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788802384.377439:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1788802384.387399:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 228: rc = 0 00100000:10000000:2.0:1788802384.387507:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 228: rc = 0 00100000:10000000:2.0:1788802384.388016:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788802384.388312:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 233: rc = 0 00100000:10000000:2.0:1788802384.392092:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 233: rc = 0 00100000:10000000:2.0:1788802384.397201:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788802384.397534:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 233: rc = 0 00100000:10000000:2.0:1788802384.398781:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788802384.399050:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 233: rc = 0 00100000:10000000:2.0:1788802384.399304:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788802384.399877:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788802384.400135:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 233: rc = 0 00100000:10000000:2.0:1788802384.400778:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 233: rc = 0 00100000:10000000:2.0:1788802384.401028:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 233: rc = 0 00100000:10000000:2.0:1788802384.401908:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 769: rc = 0 00100000:10000000:2.0:1788802384.402275:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 769: rc = 0 00100000:10000000:2.0:1788802384.402778:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 769: rc = 0 00100000:10000000:2.0:1788802384.403044:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 769: rc = 0 00100000:10000000:2.0:1788802384.403570:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 769: rc = 0 00100000:10000000:2.0:1788802384.403975:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 769: rc = 0 00100000:10000000:2.0:1788802384.404353:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 769: rc = 0 00100000:10000000:2.0:1788802384.407774:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 769: rc = 0 00100000:10000000:2.0:1788802384.408044:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 769: rc = 0 00100000:10000000:2.0:1788802384.408342:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 769: rc = 0 00100000:10000000:3.0:1788802384.409445:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 769: rc = 0 00100000:10000000:3.0:1788802384.409855:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 769: rc = 0 00100000:10000000:3.0:1788802384.410120:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 769: rc = 0 00100000:10000000:3.0:1788802384.411533:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 769: rc = 0 00100000:10000000:3.0:1788802384.411972:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 769: rc = 0 00100000:10000000:3.0:1788802384.412288:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 769: rc = 0 00100000:10000000:3.0:1788802384.412570:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 769: rc = 0 00100000:10000000:3.0:1788802384.413352:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 769: rc = 0 00100000:10000000:3.0:1788802384.415280:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 769: rc = 0 00100000:10000000:3.0:1788802384.415874:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 769: rc = 0 00100000:10000000:3.0:1788802384.416095:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 769: rc = 0 00100000:10000000:3.0:1788802384.416861:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 769: rc = 0 00100000:10000000:3.0:1788802384.417087:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 769: rc = 0 00100000:10000000:3.0:1788802384.417800:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 769: rc = 0 00100000:10000000:3.0:1788802384.418048:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 769: rc = 0 00100000:10000000:3.0:1788802384.418732:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 769: rc = 0 00100000:10000000:3.0:1788802384.418991:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 769: rc = 0 00100000:10000000:3.0:1788802384.424907:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 769: rc = 0 00100000:10000000:3.0:1788802384.425875:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 769: rc = 0 00100000:10000000:3.0:1788802384.426157:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 769: rc = 0 00100000:10000000:3.0:1788802384.430258:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 769: rc = 0 00100000:10000000:3.0:1788802384.431909:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 769: rc = 0 00100000:10000000:3.0:1788802384.433536:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 246: rc = 0 00100000:10000000:3.0:1788802384.437792:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788802384.437986:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 229: rc = 0 00100000:10000000:3.0:1788802384.438177:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788802384.438275:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 229: rc = 0 00100000:10000000:3.0:1788802384.438475:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788802384.438539:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 229: rc = 0 00100000:10000000:3.0:1788802384.438884:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788802384.438957:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 305: rc = 0 00100000:10000000:3.0:1788802384.439149:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788802384.439216:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 305: rc = 0 00100000:10000000:3.0:1788802384.439480:0:14335:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788802384.439548:0:14335:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 305: rc = 0 00000020:00000080:3.0:1788802384.439850:0:14335:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788802384.439858:0:14335:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788802384.439872:0:14335:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9cd59 00000020:01000004:3.0:1788802384.439882:0:14335:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788802384.439887:0:14335:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788802384.439898:0:14335:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910d3f90d800 from MGS 00000020:01000004:3.0:1788802384.439903:0:14335:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788802384.439913:0:14335:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff910d3436cd40) 00000020:00000080:3.0:1788802384.439925:0:14335:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788802384.439984:0:14335:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d3f90d800 from MGS, refs=2 00080000:01000000:3.0:1788802384.439989:0:14335:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788802384.439993:0:14335:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9cd67 00000100:00100000:3.0:1788802384.440085:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788802384.440215:0:14335:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788802384.440221:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788802384.442571:0:14335:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788802384.442587:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788802384.443594:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788802384.443861:0:14335:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788802384.443868:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788802384.444823:0:14335:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788802384.444852:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788802384.445698:0:14335:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788802384.445710:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788802384.446749:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802384.446753:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802384.446755:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802384.447005:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802384.447008:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802384.447009:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802384.452802:0:14335:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788802384.457591:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788802384.481384:0:14335:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788802384.481402:0:14335:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788802384.481405:0:14335:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788802384.486211:0:14344:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788802384.492478:0:14335:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788802384.492728:0:14335:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788802384.493284:0:14335:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788802384.493600:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788802384.493774:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788802384.493780:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788802384.497511:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788802384.497525:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788802384.498413:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788802384.498423:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788802384.501524:0:14335:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788802384.501550:0:14335:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.157@tcp' 00000020:01000004:2.0:1788802384.501552:0:14335:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788802384.501585:0:14335:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.157@tcp (typ=mgc) 00000020:00000080:2.0:1788802384.501599:0:14335:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.157@tcp (ffff910d07c43380) 00000100:00080000:0.0:1788802384.501803:0:14349:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788802384.501832:0:14335:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788802384.501909:0:14335:0:(ldlm_lib.c:102:import_set_conn()) imp ffff910d347c2800@MGC192.168.201.157@tcp: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788802384.502063:0:14335:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.157@tcp-0 is initialized 00000040:01000000:2.0:1788802384.502070:0:14335:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788802384.509638:0:14350:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788802384.509846:0:14335:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.157@tcp (uuid 87cc913b-814f-413d-b622-408baef57c45) 00000020:00000080:0.0:1788802384.509875:0:14335:0:(genops.c:1384:class_connect()) connect: client 87cc913b-814f-413d-b622-408baef57c45, cookie 0x6ecba1490fc9cd75 00000100:00080000:0.0:1788802384.509889:0:14335:0:(import.c:545:import_select_connection()) MGC192.168.201.157@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788802384.509901:0:14335:0:(import.c:666:import_select_connection()) MGC192.168.201.157@tcp: import ffff910d347c2800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788802384.509933:0:14335:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d10d3c380 x1875694892177280/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788802384.509961:0:14335:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 87cc913b-814f-413d-b622-408baef57c45->MGS 00000020:01000004:0.0:1788802384.509979:0:14335:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788802384.509984:0:14335:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788802384.509998:0:14335:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff910d10cb8000) 00000020:00000080:0.0:1788802384.510009:0:14335:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788802384.515210:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:87cc913b-814f-413d-b622-408baef57c45:3310:1875694892177280:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788802384.515303:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802384.517289:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892177280 00000100:00100000:1.0:1788802384.517304:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892177280 00000100:00100000:1.0:1788802384.517361:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802384.517370:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1875694892177280:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788802384.517398:0:14346:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 87cc913b-814f-413d-b622-408baef57c45@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1788802384.517426:0:14346:0:(genops.c:1384:class_connect()) connect: client 87cc913b-814f-413d-b622-408baef57c45, cookie 0x6ecba1490fc9cd83 00000100:00080000:1.0:1788802384.517568:0:14346:0:(import.c:65:import_set_state_nolock()) ffff910d037c3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788802384.517683:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+5:3310:x1875694892177280:12345-0@lo:250:mount.lustre.0 Request processed in 312us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802384.517692:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788802384.518836:0:3310:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.157@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788802384.518851:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.157@tcp: connect to target with instance 0 00000100:00080000:3.0:1788802384.518861:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.157@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788802384.518866:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788802384.518871:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d347c2800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788802384.518875:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788802384.518885:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788802384.518891:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:87cc913b-814f-413d-b622-408baef57c45:3310:1875694892177280:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788802384.529402:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788802384.529811:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788802384.529817:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788802384.531039:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788802384.531048:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788802384.533276:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788802384.533290:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788802384.536424:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788802384.536967:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788802384.536975:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788802384.537886:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788802384.537897:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788802384.581551:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788802384.581792:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788802384.581798:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788802384.583357:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788802384.583457:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788802384.585883:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788802384.586084:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788802384.586091:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788802384.588774:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788802384.588796:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788802384.589514:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788802384.589704:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788802384.589709:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788802384.596501:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788802384.596519:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788802384.597755:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788802384.597940:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788802384.597946:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788802384.600096:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788802384.600109:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788802384.613614:0:14335:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788802384.613827:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788802384.613843:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788802384.615199:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788802384.615212:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788802384.617996:0:14335:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788802384.618013:0:14335:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788802384.619446:0:14335:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788802384.619556:0:14335:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788802384.619564:0:14335:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788802384.619707:0:14335:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788802384.619742:0:14335:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.157@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788802384.619746:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788802384.619748:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788802384.619750:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802384.619751:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802384.619752:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802384.619754:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802384.619755:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788802384.619756:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788802384.619758:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802384.619759:0:14335:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788802384.619761:0:14335:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788802384.619763:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788802384.619765:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788802384.619766:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802384.619767:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802384.619768:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802384.619769:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802384.619770:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788802384.619771:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788802384.619772:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802384.619773:0:14335:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788802384.619799:0:14335:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788802384.619817:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892177408:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788802384.619897:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802384.619992:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d15752f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788802384.620049:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892177408 00000100:00100000:0.0:1788802384.620107:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892177408 00000100:00100000:0.0:1788802384.620193:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788802384.620204:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+5:14335:x1875694892177408:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788802384.620277:0:14348:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788802384.620281:0:14348:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788802384.620285:0:14348:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788802384.620667:0:14369:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788802384.621026:0:14348:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788802384.622410:0:14370:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788802384.622418:0:14370:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788802384.622420:0:14370:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788802384.622455:0:14370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788802384.622800:0:14348:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788802384.622812:0:14348:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788802384.631143:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+5:14335:x1875694892177408:12345-0@lo:253:mount.lustre.0 Request processed in 10932us (11237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.631163:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788802384.631556:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892177408:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788802384.631591:0:14335:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788802384.631594:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788802384.631596:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788802384.631597:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802384.631598:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802384.631599:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802384.631601:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802384.631602:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788802384.631603:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788802384.631606:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802384.631607:0:14335:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788802384.631630:0:14335:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910d3f90d800 from lustre-MDT0000 10000000:01000000:1.0:1788802384.631660:0:14335:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788802384.631663:0:14335:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788802384.631668:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff910d07c43380 10000000:01000000:1.0:1788802384.631675:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788802384.631683:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff910d07c43380 from 1 10000000:01000000:1.0:1788802384.631686:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788802384.631726:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802384.631738:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802384.631747:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802384.631767:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892177536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788802384.631808:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802384.631848:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08174f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802384.631914:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892177536 00000100:00100000:3.0:1788802384.631921:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892177536 00000100:00100000:3.0:1788802384.631961:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788802384.631969:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+5:14335:x1875694892177536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788802384.631990:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802384.632005:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee9a00/0x6ecba1490fc9cd91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9cd8a expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.632027:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee9a00/0x6ecba1490fc9cd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9cd8a expref: 6 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.632038:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee9a00/0x6ecba1490fc9cd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9cd8a expref: 6 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.632047:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9a00, rc 0) 00000100:00100000:3.0:1788802384.632103:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+6:14335:x1875694892177536:12345-0@lo:101:mount.lustre.0 Request processed in 134us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802384.632109:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788802384.632180:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892177536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788802384.632193:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd91 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.632202:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9cd91 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802384.632303:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892177664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802384.632340:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802384.632362:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d167b0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788802384.632568:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892177664 00000100:00100000:3.0:1788802384.632573:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892177664 00000100:00100000:3.0:1788802384.632606:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788802384.632612:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+6:14335:x1875694892177664:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788802384.632832:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+6:14335:x1875694892177664:12345-0@lo:501:mount.lustre.0 Request processed in 220us (491us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788802384.632840:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788802384.632969:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892177664:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788802384.632999:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788802384.633016:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd91 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.633024:0:14335:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd91 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802384.633032:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910d3f90d800 10000000:01000000:2.0:1788802384.633036:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788802384.633041:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff910d3f90d800 10000000:01000000:2.0:1788802384.633043:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788802384.633046:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff910d3f90d800 from 1 10000000:01000000:2.0:1788802384.633049:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788802384.633071:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216e400/0x6ecba1490fc9cd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.633078:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d4216e400/0x6ecba1490fc9cd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.633086:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d4216e400/0x6ecba1490fc9cd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802384.633100:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892177792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788802384.633141:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802384.633154:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d167b0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788802384.633452:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892177792 00000100:00100000:3.0:1788802384.633458:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892177792 00000100:00100000:3.0:1788802384.633565:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788802384.633572:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+6:14335:x1875694892177792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788802384.633581:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802384.633592:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee8200/0x6ecba1490fc9cd9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9cd98 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.633624:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee8200/0x6ecba1490fc9cd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9cd98 expref: 7 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.633633:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee8200/0x6ecba1490fc9cd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9cd98 expref: 7 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.633641:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8200, rc 0) 00000100:00100000:3.0:1788802384.633682:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+7:14335:x1875694892177792:12345-0@lo:101:mount.lustre.0 Request processed in 110us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802384.633689:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788802384.634032:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892177792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788802384.634045:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d4216e400/0x6ecba1490fc9cd98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd9f expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.634079:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d4216e400/0x6ecba1490fc9cd98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9cd9f expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802384.634095:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788802384.634108:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216e400/0x6ecba1490fc9cd98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd9f expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.634116:0:14335:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d4216e400/0x6ecba1490fc9cd98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd9f expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802384.634122:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788802384.634126:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788802384.634131:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff910d3f90d800 10000000:01000000:2.0:1788802384.634134:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788802384.634137:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788802384.634140:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788802384.634159:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9cda6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.634167:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9cda6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.634174:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9cda6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802384.634190:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892177920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788802384.634624:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802384.634696:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d167b0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788802384.634751:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892177920 00000100:00100000:3.0:1788802384.634757:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892177920 00000100:00100000:3.0:1788802384.634830:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788802384.634839:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d03933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+7:14335:x1875694892177920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788802384.634850:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802384.634861:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee9800/0x6ecba1490fc9cdad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9cda6 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.634877:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee9800/0x6ecba1490fc9cdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9cda6 expref: 8 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.634887:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee9800/0x6ecba1490fc9cdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9cda6 expref: 8 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.634894:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9800, rc 0) 00000100:00100000:3.0:1788802384.634940:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d03933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+8:14335:x1875694892177920:12345-0@lo:101:mount.lustre.0 Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802384.634946:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788802384.635020:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892177920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788802384.635034:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9cda6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cdad expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.635044:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9cda6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9cdad expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802384.635109:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892178048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788802384.635137:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802384.635331:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d06385a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.635495:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892178048 00000100:00100000:2.0:1788802384.635500:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892178048 00000100:00100000:2.0:1788802384.635525:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802384.635531:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d03932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+8:14335:x1875694892178048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802384.635914:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d03932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+9:14335:x1875694892178048:12345-0@lo:501:mount.lustre.0 Request processed in 381us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.635922:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788802384.636298:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892178048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788802384.636347:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892178176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788802384.636396:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802384.636426:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d06385a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.636498:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892178176 00000100:00100000:2.0:1788802384.636503:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892178176 00000100:00100000:2.0:1788802384.636526:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788802384.636532:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d03932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+9:14335:x1875694892178176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788802384.636826:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d03932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+9:14335:x1875694892178176:12345-0@lo:503:mount.lustre.0 Request processed in 292us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.636833:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788802384.636981:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892178176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788802384.638012:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14371:1875694892178304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802384.638062:0:14371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802384.638096:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d06385cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.638148:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892178304 00000100:00100000:2.0:1788802384.638153:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892178304 00000100:00100000:2.0:1788802384.638178:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788802384.638185:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d03930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+9:14371:x1875694892178304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802384.638614:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d03930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+9:14371:x1875694892178304:12345-0@lo:502:llog_process_th.0 Request processed in 428us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.638622:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788802384.639387:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14371:1875694892178304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788802384.639420:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788802384.639430:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802384.639433:0:14371:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788802384.639438:0:14371:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788802384.639442:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788802384.639458:0:14371:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff910d10cbb380) 00000020:00000080:0.0:1788802384.639546:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788802384.639551:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788802384.639615:0:14371:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788802384.639621:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9cdbb 00000020:00000080:0.0:1788802384.639812:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788802384.639815:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802384.639818:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802384.639820:0:14371:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788802384.639822:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788802384.639825:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802384.639827:0:14371:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788802384.639830:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788802384.639836:0:14371:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff910d10cbcd40) 00000020:00000080:0.0:1788802384.639844:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788802384.639847:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788802384.639849:0:14371:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788802384.639859:0:14371:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788802384.639865:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788802384.639911:0:14371:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d3f90d800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788802384.639922:0:14371:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff910d10cb99c0) 00000020:00000080:0.0:1788802384.639929:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788802384.639976:0:14371:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788802384.639981:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6ecba1490fc9cdd0 00000020:00000080:0.0:1788802384.640062:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788802384.640067:0:14371:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788802384.640071:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6ecba1490fc9cdd7 00080000:01000000:0.0:1788802384.640076:0:14371:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788802384.640079:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9cdde 00010000:00010000:2.0:1788802384.762535:0:14371:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788802384.762984:0:14371:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788802384.763169:0:14371:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788802384.768410:0:14371:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff910d10d599c0) 00000020:00000080:0.0:1788802384.768437:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788802384.768536:0:14371:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788802384.768546:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9cdec 00000020:00000080:0.0:1788802384.774100:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788802384.782956:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6ecba1490fc9cdf3 00000020:00000080:0.0:1788802384.788875:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788802384.788889:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802384.788898:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802384.788900:0:14371:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788802384.788903:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788802384.788909:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802384.788910:0:14371:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788802384.788914:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788802384.788958:0:14371:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788802384.788970:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802384.788973:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802384.788974:0:14371:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788802384.788976:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788802384.788978:0:14371:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788802384.788979:0:14371:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788802384.788995:0:14371:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788802384.788997:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788802384.789000:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802384.789001:0:14371:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788802384.789003:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788802384.789007:0:14371:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788802384.789010:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802384.789011:0:14371:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788802384.789014:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788802384.789020:0:14371:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.157@tcp to nid 0x20000c0a8c99d (192.168.201.157@tcp) 00000020:01000000:0.0:1788802384.789045:0:14371:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788802384.789049:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788802384.789065:0:14371:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff910d10d5b380) 00000020:00000080:0.0:1788802384.789084:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788802384.789088:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788802384.789143:0:14371:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788802384.789149:0:14371:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788802384.789156:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9ce01 00010000:00080000:0.0:1788802384.789185:0:14371:0:(ldlm_lib.c:102:import_set_conn()) imp ffff910d08d99800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:0.0:1788802384.789460:0:14371:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788802384.789874:0:14371:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788802384.789915:0:14371:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788802384.790841:0:14371:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788802384.790900:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788802384.790970:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788802384.799981:0:14375:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788802384.799991:0:14375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788802384.805698:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788802384.805714:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788802384.805876:0:14371:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788802384.805899:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6ecba1490fc9ce08 00000100:00080000:2.0:1788802384.805910:0:14371:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788802384.806007:0:14371:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff910d08d99800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788802384.806046:0:14371:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d3fad5180 x1875694892178432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788802384.806124:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892178432:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788802384.806186:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875694892178432 offset 0 length 520: 4 00000100:00080000:2.0:1788802384.806343:0:14371:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788802384.806413:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802384.806418:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802384.806420:0:14371:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788802384.806423:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788802384.806425:0:14371:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788802384.806426:0:14371:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788802384.806428:0:14371:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788802384.806429:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788802384.806431:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802384.806432:0:14371:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788802384.806434:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788802384.806438:0:14371:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788802384.806441:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802384.806442:0:14371:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788802384.806444:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788802384.806448:0:14371:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.157@tcp to nid 0x20000c0a8c99d (192.168.201.157@tcp) 00000020:01000000:2.0:1788802384.806471:0:14371:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788802384.806474:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788802384.806488:0:14371:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff910d07c44d40) 00000020:00000080:2.0:1788802384.806500:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788802384.806507:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788802384.806576:0:14371:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788802384.806583:0:14371:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788802384.806591:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6ecba1490fc9ce16 00010000:00080000:2.0:1788802384.806637:0:14371:0:(ldlm_lib.c:102:import_set_conn()) imp ffff910d3382b800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788802384.806884:0:14371:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788802384.807333:0:14371:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788802384.807374:0:14371:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788802384.808474:0:14371:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788802384.808807:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788802384.809022:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788802384.809767:0:14377:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788802384.809773:0:14377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788802384.810845:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788802384.810858:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788802384.810891:0:14371:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788802384.810982:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6ecba1490fc9ce1d 00000100:00080000:2.0:1788802384.810994:0:14371:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788802384.811007:0:14371:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910d3382b800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788802384.811057:0:14371:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d3fad5c00 x1875694892178560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788802384.811118:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892178560:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788802384.811190:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875694892178560 offset 0 length 520: 4 00000100:00080000:2.0:1788802384.811332:0:14371:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788802384.811394:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802384.811399:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802384.811401:0:14371:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788802384.811404:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802384.811408:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802384.811409:0:14371:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788802384.811412:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788802384.811413:0:14371:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788802384.811416:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802384.811418:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802384.811419:0:14371:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788802384.811421:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802384.811422:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802384.811423:0:14371:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788802384.811427:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788802384.811457:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14371:1875694892178688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802384.811513:0:14371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802384.811560:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892178688 00000100:00100000:2.0:1788802384.811566:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892178688 00000100:00100000:2.0:1788802384.811681:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788802384.811690:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d03931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+9:14371:x1875694892178688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802384.812148:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d03931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+9:14371:x1875694892178688:12345-0@lo:502:llog_process_th.0 Request processed in 458us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.812226:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788802384.812295:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d358d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.812314:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14371:1875694892178688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788802384.812351:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802384.812356:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802384.812358:0:14371:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788802384.812363:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788802384.812556:0:14335:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788802384.812698:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788802384.812722:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9cda6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cdad expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.812733:0:14335:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d4216f600/0x6ecba1490fc9cda6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cdad expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802384.812741:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff910d3f90d800 from 1 10000000:01000000:0.0:1788802384.812743:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788802384.812775:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.812782:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.812793:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802384.812811:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892178816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788802384.812848:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802384.812875:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.814361:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892178816 00000100:00100000:2.0:1788802384.814373:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892178816 00000100:00100000:2.0:1788802384.814432:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788802384.814441:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+9:14335:x1875694892178816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788802384.814456:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802384.814474:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9ce2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9ce24 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.814499:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9ce2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce24 expref: 10 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.814510:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9ce2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce24 expref: 10 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.814546:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216e000, rc 0) 00000100:00100000:2.0:1788802384.814723:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+10:14335:x1875694892178816:12345-0@lo:101:mount.lustre.0 Request processed in 282us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.814730:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788802384.814817:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892178816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788802384.814832:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.814842:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802384.815368:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892178944:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788802384.815414:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802384.815444:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.815696:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892178944 00000100:00100000:2.0:1788802384.815702:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892178944 00000100:00100000:2.0:1788802384.815739:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788802384.815746:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+10:14335:x1875694892178944:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788802384.815761:0:14347:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788802384.815767:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788802384.815832:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+10:14335:x1875694892178944:12345-0@lo:256:mount.lustre.0 Request processed in 86us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.815839:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788802384.816002:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892178944:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788802384.816769:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788802384.816795:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.816806:0:14335:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802384.816814:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d3f90d800 from 1 10000000:01000000:0.0:1788802384.816817:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788802384.816846:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.816854:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.816864:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802384.816880:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788802384.816989:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802384.817082:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802384.817124:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892179072 00000100:00100000:3.0:1788802384.817130:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892179072 00000100:00100000:3.0:1788802384.817384:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788802384.817394:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+10:14335:x1875694892179072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788802384.817405:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802384.817419:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9ce39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9ce32 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.817440:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9ce39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce32 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.817450:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9ce39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce32 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.817457:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8c00, rc 0) 00000100:00100000:3.0:1788802384.817547:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+11:14335:x1875694892179072:12345-0@lo:101:mount.lustre.0 Request processed in 154us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802384.817554:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788802384.817732:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788802384.817756:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.817765:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802384.817812:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788802384.817837:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802384.817901:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802384.817994:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892179200 00000100:00100000:3.0:1788802384.817998:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892179200 00000100:00100000:3.0:1788802384.818027:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788802384.818034:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+11:14335:x1875694892179200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802384.818638:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+11:14335:x1875694892179200:12345-0@lo:501:mount.lustre.0 Request processed in 601us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.818648:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788802384.818685:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788802384.818728:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788802384.818769:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802384.818802:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802384.818863:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892179328 00000100:00100000:3.0:1788802384.818868:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892179328 00000100:00100000:3.0:1788802384.818901:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788802384.818908:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+11:14335:x1875694892179328:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788802384.819113:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+11:14335:x1875694892179328:12345-0@lo:503:mount.lustre.0 Request processed in 205us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802384.819130:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788802384.819434:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788802384.820405:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14379:1875694892179456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802384.820459:0:14379:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802384.820542:0:14379:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72180 going to sleep for 11 seconds 00000100:00100000:0.0:1788802384.820691:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892179456 00000100:00100000:0.0:1788802384.820698:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892179456 00000100:00100000:0.0:1788802384.820774:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788802384.820783:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+11:14379:x1875694892179456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788802384.821027:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+11:14379:x1875694892179456:12345-0@lo:502:llog_process_th.0 Request processed in 245us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802384.821035:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788802384.821119:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14379:1875694892179456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788802384.821148:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788802384.821161:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802384.821163:0:14379:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788802384.821171:0:14379:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d3f90d800 00000020:00000080:1.0:1788802384.821174:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788802384.821183:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788802384.821185:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802384.821187:0:14379:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788802384.821189:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788802384.821191:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802384.821193:0:14379:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788802384.821195:0:14379:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d3f90d800 00000020:00000080:1.0:1788802384.821197:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788802384.821284:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788802384.821288:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802384.821290:0:14379:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788802384.821292:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788802384.821295:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802384.821297:0:14379:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788802384.821300:0:14379:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910d3f90d800 00000020:00000080:1.0:1788802384.821302:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788802384.821349:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14379:1875694892179584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788802384.821387:0:14379:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802384.821415:0:14379:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d081743c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802384.821666:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892179584 00000100:00100000:3.0:1788802384.821672:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892179584 00000100:00100000:3.0:1788802384.821710:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788802384.821718:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+11:14379:x1875694892179584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802384.821866:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+11:14379:x1875694892179584:12345-0@lo:502:llog_process_th.0 Request processed in 149us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802384.821873:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788802384.822369:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14379:1875694892179584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788802384.822397:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788802384.822404:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788802384.822405:0:14379:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788802384.822410:0:14379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788802384.822869:0:14335:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788802384.822894:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788802384.823118:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.823131:0:14335:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802384.823273:0:14335:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788802384.823277:0:14335:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910d3f90d800 10000000:01000000:3.0:1788802384.823280:0:14335:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910d3f90d800 10000000:01000000:3.0:1788802384.823284:0:14335:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788802384.823289:0:14335:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d3f90d800 from 1 10000000:01000000:3.0:1788802384.823292:0:14335:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788802384.823335:0:14335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9ce40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.823354:0:14335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9ce40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.823365:0:14335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9ce40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802384.823385:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788802384.823435:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802384.823474:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.823698:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892179712 00000100:00100000:2.0:1788802384.823705:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892179712 00000100:00100000:2.0:1788802384.823740:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788802384.823748:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+11:14335:x1875694892179712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788802384.823760:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802384.823774:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216f800/0x6ecba1490fc9ce47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9ce40 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.823798:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216f800/0x6ecba1490fc9ce47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce40 expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.823820:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216f800/0x6ecba1490fc9ce47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce40 expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.823830:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216f800, rc 0) 00000100:00100000:2.0:1788802384.823873:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:14335:x1875694892179712:12345-0@lo:101:mount.lustre.0 Request processed in 126us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.823879:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788802384.824691:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788802384.824708:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9ce40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce47 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.824719:0:14335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9ce40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9ce47 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802384.824775:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788802384.824808:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802384.824837:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72300 going to sleep for 11 seconds 00000100:00100000:1.0:1788802384.824851:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892179840 00000100:00100000:1.0:1788802384.824858:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892179840 00000100:00100000:1.0:1788802384.824939:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788802384.824948:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+12:14335:x1875694892179840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788802384.825226:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+12:14335:x1875694892179840:12345-0@lo:501:mount.lustre.0 Request processed in 279us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802384.825234:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788802384.825346:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788802384.825378:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788802384.825422:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802384.825601:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.825627:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892179968 00000100:00100000:2.0:1788802384.825631:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892179968 00000100:00100000:2.0:1788802384.825653:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788802384.825659:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:14335:x1875694892179968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788802384.825822:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:14335:x1875694892179968:12345-0@lo:503:mount.lustre.0 Request processed in 161us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.825828:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788802384.825978:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892179968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788802384.827095:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14381:1875694892180096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802384.827162:0:14381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802384.827227:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.829472:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892180096 00000100:00100000:2.0:1788802384.829487:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892180096 00000100:00100000:2.0:1788802384.829564:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788802384.829576:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:14381:x1875694892180096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788802384.829984:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:14381:x1875694892180096:12345-0@lo:502:llog_process_th.0 Request processed in 409us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.829991:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788802384.830122:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14381:1875694892180096:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788802384.830194:0:14381:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788802384.830208:0:14381:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff910d343699c0) 00000020:00000080:3.0:1788802384.830228:0:14381:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788802384.830589:0:14381:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d3f90d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788802384.830595:0:14381:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910d3f90d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788802384.830598:0:14381:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d3f90d800 4 00010000:00080000:3.0:1788802384.830626:0:14381:0:(ldlm_lib.c:102:import_set_conn()) imp ffff910d3efbf800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788802384.838534:0:14381:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788802384.838857:0:14381:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788802384.838908:0:14381:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788802384.838924:0:14381:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6ecba1490fc9ce55 00000100:00080000:2.0:1788802384.838934:0:14381:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788802384.838955:0:14381:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff910d3efbf800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788802384.839000:0:14381:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d3fad5500 x1875694892180224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788802384.839051:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875694892180224:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788802384.839124:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802384.839697:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892180224 00000100:00100000:0.0:1788802384.839707:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892180224 00000100:00100000:0.0:1788802384.839751:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788802384.839760:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875694892180224:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788802384.839824:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875694892180224:12345-0@lo:38:llog_process_th.0 Request processed in 64us (699us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788802384.839838:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788802384.839840:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788802384.839851:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3efbf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788802384.839871:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788802384.839875:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875694892180224:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788802384.839924:0:14381:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788802384.844515:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14381:1875694892180352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802384.844600:0:14381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802384.844639:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892180352 00000100:00100000:3.0:1788802384.844645:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892180352 00000100:00100000:3.0:1788802384.845363:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788802384.845376:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+12:14381:x1875694892180352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788802384.845642:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+12:14381:x1875694892180352:12345-0@lo:502:llog_process_th.0 Request processed in 269us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802384.845651:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788802384.846398:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72840 going to sleep for 11 seconds 00000100:00100000:3.0:1788802384.846424:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:87cc913b-814f-413d-b622-408baef57c45:14381:1875694892180352:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788802384.846457:0:14381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788802384.846911:0:14335:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788802384.846935:0:14335:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788802384.846958:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9ce40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce47 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802384.846970:0:14335:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3eee8e00/0x6ecba1490fc9ce40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce47 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788802384.847013:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788802384.847016:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788802384.847017:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788802384.847018:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788802384.847020:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788802384.847021:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788802384.847023:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788802384.847024:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788802384.847026:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788802384.847028:0:14335:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788802384.847031:0:14335:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788802384.847033:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788802384.847038:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788802384.847039:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788802384.847040:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788802384.847041:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788802384.847042:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788802384.847043:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788802384.847044:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788802384.847045:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788802384.847046:0:14335:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788802384.847077:0:14335:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788802384.847096:0:14335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892180480:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788802384.847148:0:14335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802384.847174:0:14335:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.847194:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892180480 00000100:00100000:2.0:1788802384.847200:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892180480 00000100:00100000:1.0:1788802384.849221:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788802384.849532:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+12:14335:x1875694892180480:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788802384.849570:0:14347:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788802384.849594:0:14347:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788802384.915095:0:14347:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788802384.915152:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788802384.915833:0:14369:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788802384.915840:0:14369:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788802384.915862:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.915903:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9ce2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce24 expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.915983:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.916029:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9ce2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9ce24 expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802384.916044:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9ce2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce24 expref: 12 pid: 14346 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802384.916059:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14369:1875694892180608:0@lo:104: 00000100:00100000:3.0:1788802384.916129:0:14369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802384.916177:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f72240 going to sleep for 11 seconds 00000100:00100000:2.0:1788802384.916539:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892180608 00000100:00100000:2.0:1788802384.916548:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892180608 00000100:00100000:2.0:1788802384.916593:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788802384.916601:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+3:14369:x1875694892180608:12345-0@lo:104: 00010000:00010000:2.0:1788802384.916615:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802384.916692:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14369:1875694892180608:0@lo:104: 00010000:00010000:2.0:1788802384.916715:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788802384.916716:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802384.916726:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+3:14369:x1875694892180608:12345-0@lo:104: Request processed in 124us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802384.916736:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788802384.916947:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802384.916955:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802384.916963:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0e00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802384.916967:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802384.916977:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802384.916984:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802384.916990:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788802384.917053:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802384.917060:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802384.917088:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802384.917105:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d206f0e00/0x6ecba1490fc9ce24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802384.917122:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802384.917124:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802384.917125:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802384.917179:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87cc913b-814f-413d-b622-408baef57c45:3312:1875694892180736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788802384.917229:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802384.917297:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892180736 00000100:00100000:0.0:1788802384.917301:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892180736 00010000:00010000:0.0:1788802384.917330:0:14338:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9ce2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce24 expref: 13 pid: 14346 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802384.917351:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788802384.917358:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87cc913b-814f-413d-b622-408baef57c45+13:3312:x1875694892180736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788802384.917367:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802384.917372:0:14338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9ce2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce24 expref: 13 pid: 14346 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917382:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9ce2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce24 expref: 13 pid: 14346 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917394:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9ce2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9ce24 expref: 13 pid: 14346 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917407:0:14338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917416:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788802384.917428:0:14338:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001589933s 00010000:00010000:0.0:1788802384.917432:0:14338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917449:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917457:0:14338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917463:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917468:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8800 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802384.917473:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917481:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917494:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917502:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802384.917527:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87cc913b-814f-413d-b622-408baef57c45+12:3312:x1875694892180736:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802384.917534:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788802384.917561:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87cc913b-814f-413d-b622-408baef57c45:3312:1875694892180736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788802384.917577:0:14369:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917586:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802384.917602:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9ce5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802384.922555:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+11:14335:x1875694892180480:12345-0@lo:253:mount.lustre.0 Request processed in 73034us (75397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802384.922572:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788802384.922578:0:14335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:14335:1875694892180480:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788802384.922597:0:14335:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788802384.922601:0:14335:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788802384.922603:0:14335:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788802384.922606:0:14335:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788802384.922607:0:14335:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788802384.922621:0:14335:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788802384.922623:0:14335:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788802384.922624:0:14335:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788802384.922625:0:14335:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788802384.922627:0:14335:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788802384.922628:0:14335:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788802384.922643:0:14335:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788802384.930609:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802384.930821:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788802384.931089:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802384.931447:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788802384.931765:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802384.931920:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788802384.933075:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802384.933218:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788802384.933629:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802384.933828:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788802384.934017:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802384.934132:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788802384.948176:0:14335:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788802384.948573:0:14335:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788802384.948573:0:14392:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788802384.948576:0:14392:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788802384.948850:0:14393:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788802384.948916:0:14393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788802384.950069:0:14335:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788802384.950173:0:14335:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788802384.951173:0:14335:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788802384.951186:0:14335:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788802384.951496:0:14335:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788802384.951502:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788802384.951555:0:14393:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788802384.951559:0:14393:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788802384.952504:0:14335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788802384.952898:0:14335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788802384.952919:0:14335:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788802384.954109:0:14335:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788802384.957609:0:14335:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788802384.972799:0:14335:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788802384.972836:0:14335:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafe64196b988 00100000:10000000:3.0:1788802384.972844:0:14335:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788802384.973128:0:14335:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788802384.973142:0:14335:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788802384.973155:0:14335:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788802384.973175:0:14335:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788802385.484946:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788802385.868964:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788802386.009438:0:14350:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788802386.009454:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff910d3f90d800 from 6 10000000:01000000:0.0:1788802386.009460:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788802386.010551:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802386.010572:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802386.010588:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802386.010616:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892180864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788802386.010688:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802386.010736:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08623240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802386.022691:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892180864 00000100:00100000:3.0:1788802386.022706:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892180864 00000100:00100000:3.0:1788802386.022782:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788802386.022792:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+11:14350:x1875694892180864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802386.022809:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802386.022828:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee8600/0x6ecba1490fc9ce6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9ce63 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802386.022856:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee8600/0x6ecba1490fc9ce6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce63 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802386.022867:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee8600/0x6ecba1490fc9ce6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce63 expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802386.022876:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8600, rc 0) 00000100:00100000:3.0:1788802386.023080:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+12:14350:x1875694892180864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 290us (12391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802386.023087:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788802386.033870:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892180864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802386.033903:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802386.033916:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802386.034101:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892180992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788802386.034167:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802386.034274:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d10b57e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802386.043197:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892180992 00000100:00100000:3.0:1788802386.043214:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892180992 00000100:00100000:3.0:1788802386.050438:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788802386.050453:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+12:14350:x1875694892180992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788802386.050477:0:14347:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788802386.050493:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788802386.050496:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788802386.055811:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+12:14350:x1875694892180992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 5353us (21634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802386.055826:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788802386.059653:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892180992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788802386.067410:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788802386.067426:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802386.067439:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802386.508439:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788802386.893790:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788802387.533065:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802388.556414:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802389.585304:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788802389.900393:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788802389.900403:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788802389.900407:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788802389.900410:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788802389.900413:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788802389.900417:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788802389.900422:0:38:0:(import.c:65:import_set_state_nolock()) ffff910d3efbf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788802389.900447:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff910d3efbf800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788802389.900479:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d3fad4000 x1875694892181248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788802389.900543:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875694892181248:0@lo:38:kworker.0 00000100:00100000:2.0:1788802389.900637:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802389.900771:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87cc913b-814f-413d-b622-408baef57c45:3313:1875694892181120:0@lo:400:kworker.0 00000100:00100000:2.0:1788802389.900809:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802389.900876:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892181120 00000100:00100000:2.0:1788802389.900886:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892181120 00000100:00100000:2.0:1788802389.900939:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788802389.900950:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+12:3313:x1875694892181120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802389.901012:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+12:3313:x1875694892181120:12345-0@lo:400:kworker.0 Request processed in 62us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802389.901019:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788802389.901076:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87cc913b-814f-413d-b622-408baef57c45:3313:1875694892181120:0@lo:400:kworker.0 00000100:00100000:2.0:1788802389.901133:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892181248 00000100:00100000:2.0:1788802389.901137:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892181248 00000100:00100000:2.0:1788802389.901160:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788802389.901166:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875694892181248:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788802389.901192:0:14355:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:2.0:1788802389.901287:0:14355:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6ecba1490fc9ce71 00000004:00100000:2.0:1788802389.901310:0:14355:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788802389.901743:0:14355:0:(import.c:65:import_set_state_nolock()) ffff910d08210000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788802389.901810:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875694892181248:12345-0@lo:38:kworker.0 Request processed in 642us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802389.901818:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788802389.901869:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910d3fad4000 x1875694892181248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788802399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788802389.901901:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788802389.901912:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788802389.901918:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788802389.901922:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3efbf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788802389.901928:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875694892181248:0@lo:38:kworker.0 00010000:00010000:3.0:1788802390.605501:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788802390.645756:0:14636:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788802391.634277:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802392.652537:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802393.680420:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788802394.331062:0:14786:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9cf24980 20000000:00000080:0.0:1788802394.331094:0:14786:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910d3be6e800 uarg=0000000000000000 20000000:01000000:0.0:1788802394.331140:0:14786:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788802394.331158:0:14786:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788802394.331165:0:14786:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788802394.336054:0:14787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788802394.336512:0:14786:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788802394.347380:0:14786:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788802394.347453:0:14786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802394.347478:0:14786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9ce39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce32 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802394.347487:0:14786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802394.347547:0:14786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9ce39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9ce32 expref: 11 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802394.347567:0:14786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9ce39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce32 expref: 11 pid: 14348 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802394.347585:0:14786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14786:1875694892181376:0@lo:104: 00000100:00100000:2.0:1788802394.347678:0:14786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802394.349954:0:14786:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d10b57b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788802394.352588:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892181376 00000100:00100000:1.0:1788802394.352610:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892181376 00000100:00100000:0.0:1788802394.355145:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788802394.355176:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+3:14786:x1875694892181376:12345-0@lo:104: 00010000:00010000:0.0:1788802394.355217:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802394.355382:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788802394.355389:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+3:14786:x1875694892181376:12345-0@lo:104: Request processed in 220us (7713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802394.355398:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788802394.355474:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802394.355484:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.355494:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802394.355499:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.355517:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802394.355525:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802394.355532:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788802394.355588:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.355596:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802394.355624:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.355633:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d206f1c00/0x6ecba1490fc9ce32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce39 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.355659:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802394.355661:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802394.355662:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802394.355693:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892181504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802394.355744:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802394.355828:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892181504 00000100:00100000:1.0:1788802394.355842:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892181504 00010000:00010000:1.0:1788802394.355872:0:14338:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9ce39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce32 expref: 12 pid: 14348 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802394.355900:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788802394.355918:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87cc913b-814f-413d-b622-408baef57c45+12:3314:x1875694892181504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802394.355940:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802394.355947:0:14338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9ce39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce32 expref: 12 pid: 14348 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.355960:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9ce39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce32 expref: 12 pid: 14348 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.355981:0:14338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.355991:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.356011:0:14338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.356019:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.356026:0:14338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.356033:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.356039:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216ee00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802394.356045:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.356052:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.356073:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802394.356084:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802394.356117:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87cc913b-814f-413d-b622-408baef57c45+12:3314:x1875694892181504:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802394.356123:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788802394.356178:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892181504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788802394.357445:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9ce39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9ce32 expref: 11 pid: 14348 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802394.357490:0:14786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14786:1875694892181376:0@lo:104: 00010000:00010000:2.0:1788802394.357517:0:14786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802394.357529:0:14786:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802394.357537:0:14786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802394.357544:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ce78 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802394.708035:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802395.021950:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788802384/real 1788802384] req@ffff910d3fad5c00 x1875694892178560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788802394 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802395.021982:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910d3fad5c00 x1875694892178560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788802394 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802395.021993:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788802384/real 1788802384] req@ffff910d3fad5180 x1875694892178432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788802394 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802395.022006:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910d3fad5180 x1875694892178432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788802394 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788802395.022026:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3382b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788802395.022036:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788802395.022041:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892178560:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788802395.022047:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d08d99800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788802395.022052:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788802395.022055:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892178432:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788802395.022420:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788802395.022426:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788802395.022428:0:8:0:(import.c:65:import_set_state_nolock()) ffff910d08d99800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788802395.022433:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1788802395.022438:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788802395.022449:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff910d08d99800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788802395.022482:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d3fad4000 x1875694892181632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788802395.022494:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788802395.022497:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788802395.022499:0:8:0:(import.c:65:import_set_state_nolock()) ffff910d3382b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788802395.022502:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1788802395.022504:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788802395.022520:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910d3382b800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788802395.022532:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d3fad4380 x1875694892181760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788802395.022785:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788802395.022800:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892181888:0@lo:400:kworker.0 00000100:00100000:1.0:1788802395.023157:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892181632:0@lo:8:kworker.0 00000400:00000100:1.0:1788802395.023464:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875694892181632 offset 0 length 520: 4 00000100:00100000:1.0:1788802395.023514:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892181760:0@lo:8:kworker.0 00000400:00000100:1.0:1788802395.023536:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875694892181760 offset 0 length 520: 4 00000100:00100000:0.0:1788802395.024149:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802395.024467:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892181888 00000100:00100000:2.0:1788802395.024477:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892181888 00000100:00100000:2.0:1788802395.024534:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788802395.024545:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892181888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802395.024620:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892181888:12345-0@lo:400:kworker.0 Request processed in 78us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802395.024627:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788802395.025050:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910d3fad6d80 x1875694892181888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788802395.025146:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892181888:0@lo:400:kworker.0 00010000:00010000:1.0:1788802395.724537:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788802395.916509:0:14350:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788802395.916518:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d3f90d800 from 10 10000000:01000000:1.0:1788802395.916523:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788802395.916574:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802395.916586:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802395.916598:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802395.916626:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892182016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788802395.916720:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802395.916844:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802395.917295:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892182016 00000100:00100000:3.0:1788802395.917304:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892182016 00000100:00100000:3.0:1788802395.940711:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788802395.940737:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+11:14350:x1875694892182016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802395.940758:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802395.940780:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee9400/0x6ecba1490fc9ce86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9ce7f expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802395.940810:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee9400/0x6ecba1490fc9ce86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce7f expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802395.940822:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee9400/0x6ecba1490fc9ce86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce7f expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802395.940831:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9400, rc 0) 00000100:00100000:3.0:1788802395.940929:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+12:14350:x1875694892182016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (24209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802395.940935:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788802395.941098:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892182016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788802395.941118:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802395.941139:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802395.941226:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892182144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802395.941287:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802395.941331:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802395.941739:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892182144 00000100:00100000:3.0:1788802395.941748:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892182144 00000100:00100000:3.0:1788802395.941795:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788802395.941803:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:14350:x1875694892182144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802395.942096:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:14350:x1875694892182144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802395.942103:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788802395.942205:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892182144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802395.942262:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892182272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802395.942308:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802395.942337:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08f726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802395.942394:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892182272 00000100:00100000:3.0:1788802395.942398:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892182272 00000100:00100000:3.0:1788802395.942429:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788802395.942435:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:14350:x1875694892182272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802395.943614:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:14350:x1875694892182272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1173us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802395.943626:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788802395.956157:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892182272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788802395.960175:0:14848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788802395.960401:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788802395.960424:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788802395.960436:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802395.960458:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788802396.110297:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788802396.748648:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802397.775361:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802398.813569:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788802399.718273:0:15036:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788802399.718278:0:15036:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788802399.718408:0:15036:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff910d030ff000 00000020:01000004:0.0:1788802399.718424:0:15036:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788802399.718435:0:15036:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788802399.718448:0:15036:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff910d10d58000) 00000020:00000080:0.0:1788802399.718463:0:15036:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788802399.734544:0:15036:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788802399.734797:0:15036:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788802399.735542:0:15036:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788802399.735766:0:15036:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788802399.736000:0:15036:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788802399.738218:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 617: rc = 0 00100000:10000000:0.0:1788802399.738573:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 617: rc = 0 00100000:10000000:0.0:1788802399.738668:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 617: rc = 0 00100000:10000000:0.0:1788802399.740011:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 20: rc = 0 00100000:10000000:0.0:1788802399.740422:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 20: rc = 0 00100000:10000000:0.0:1788802399.740697:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 20: rc = 0 00100000:10000000:0.0:1788802399.740943:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 20: rc = 0 00100000:10000000:0.0:1788802399.741199:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 20: rc = 0 00100000:10000000:0.0:1788802399.741484:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 20: rc = 0 00000020:00000080:0.0:1788802399.742053:0:15036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788802399.742521:0:15036:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788802399.742535:0:15036:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6ecba1490fc9ce94 00000020:01000004:0.0:1788802399.742543:0:15036:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788802399.742565:0:15036:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.157@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788802399.742569:0:15036:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788802399.742574:0:15036:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788802399.742579:0:15036:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788802399.742592:0:15036:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff910d10d5cd40) 00000020:00000080:0.0:1788802399.742601:0:15036:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788802399.744355:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788802399.744577:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788802399.744584:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788802399.748786:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788802399.748807:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788802399.750636:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788802399.750647:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788802399.754531:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802399.754731:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788802399.754738:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788802399.761678:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788802399.761698:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788802399.788669:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802399.788912:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788802399.788920:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788802399.790201:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788802399.790211:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788802399.791067:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788802399.791075:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788802399.796893:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788802399.797298:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788802399.797306:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788802399.800206:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788802399.800221:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1788802399.820495:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802399.832539:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788802399.832756:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788802399.832763:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788802399.833899:0:15036:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788802399.833909:0:15036:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788802399.834445:0:15036:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788802399.834472:0:15036:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788802399.834479:0:15036:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788802399.854799:0:15036:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788802399.854842:0:15036:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.157@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788802399.854846:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788802399.854848:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788802399.854849:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802399.854851:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802399.854852:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802399.854853:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802399.854854:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788802399.854856:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802399.854857:0:15036:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788802399.854861:0:15036:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788802399.854863:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788802399.854864:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788802399.854865:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802399.854867:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802399.854868:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802399.854869:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802399.854870:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788802399.854871:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802399.854872:0:15036:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788802399.854901:0:15036:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788802399.854924:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892182400:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788802399.858183:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802399.858349:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788802399.858483:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892182400 00000100:00100000:0.0:1788802399.858493:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892182400 00000100:00100000:0.0:1788802399.859401:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788802399.859420:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+12:15036:x1875694892182400:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788802399.859484:0:14348:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788802399.859488:0:14348:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788802399.859491:0:14348:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788802399.867624:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+12:15036:x1875694892182400:12345-0@lo:253:mount.lustre.0 Request processed in 8200us (9440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802399.867639:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788802399.867806:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892182400:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788802399.867823:0:15036:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788802399.867827:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788802399.867828:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788802399.867830:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802399.867845:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802399.867847:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802399.867848:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802399.867850:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788802399.867851:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802399.867853:0:15036:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788802399.867874:0:15036:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910d030ff000 from lustre-OST0000 10000000:01000000:1.0:1788802399.867902:0:15036:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788802399.867905:0:15036:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788802399.867911:0:15036:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff910d07c43380 local copy 00010000:00010000:1.0:1788802399.867922:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd91 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802399.868163:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892182528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788802399.868197:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802399.868235:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3fad3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788802399.868370:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892182528 00000100:00100000:2.0:1788802399.868377:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892182528 00000100:00100000:2.0:1788802399.868419:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788802399.868428:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:15036:x1875694892182528:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802399.868594:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+12:15036:x1875694892182528:12345-0@lo:501:mount.lustre.0 Request processed in 167us (396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788802399.868601:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788802399.868874:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892182528:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788802399.868890:0:15036:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788802399.869129:0:15036:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788802399.869138:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd91 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802399.869148:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd91 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802399.869181:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910d030ff000 10000000:01000000:0.0:1788802399.869186:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788802399.869192:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff910d07c43380 10000000:01000000:0.0:1788802399.869194:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788802399.869198:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff910d07c43380 from 1 10000000:01000000:0.0:1788802399.869201:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788802399.869228:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1600/0x6ecba1490fc9cea2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802399.869272:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f1600/0x6ecba1490fc9cea2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802399.869283:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f1600/0x6ecba1490fc9cea2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802399.869301:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892182656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788802399.869334:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802399.869361:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b75f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788802399.869445:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892182656 00000100:00100000:1.0:1788802399.869451:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892182656 00000100:00100000:1.0:1788802399.869481:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788802399.869487:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+12:15036:x1875694892182656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788802399.869497:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802399.869514:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3a0f3400/0x6ecba1490fc9cea9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9cea2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.869535:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f3400/0x6ecba1490fc9cea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9cea2 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.869545:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3a0f3400/0x6ecba1490fc9cea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9cea2 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.869554:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3400, rc 0) 00000100:00100000:1.0:1788802399.869581:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+13:15036:x1875694892182656:12345-0@lo:101:mount.lustre.0 Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802399.869595:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788802399.869719:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892182656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788802399.869732:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f1600/0x6ecba1490fc9cea2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cea9 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802399.869740:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f1600/0x6ecba1490fc9cea2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9cea9 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802399.869755:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788802399.869771:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1600/0x6ecba1490fc9cea2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cea9 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802399.869790:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f1600/0x6ecba1490fc9cea2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cea9 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802399.869796:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788802399.869800:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788802399.869805:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788802399.869807:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788802399.869822:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1e00/0x6ecba1490fc9ceb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802399.869830:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f1e00/0x6ecba1490fc9ceb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802399.869838:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f1e00/0x6ecba1490fc9ceb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802399.869850:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892182784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788802399.869877:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802399.869938:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b75f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788802399.870223:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892182784 00000100:00100000:2.0:1788802399.870228:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892182784 00000100:00100000:3.0:1788802399.870502:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788802399.870512:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+13:15036:x1875694892182784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788802399.870520:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802399.870530:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9ceb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9ceb0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.870559:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9ceb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9ceb0 expref: 14 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.870569:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee9e00/0x6ecba1490fc9ceb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ceb0 expref: 14 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.870576:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9e00, rc 0) 00000100:00100000:3.0:1788802399.870623:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+14:15036:x1875694892182784:12345-0@lo:101:mount.lustre.0 Request processed in 114us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.870630:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788802399.870699:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892182784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788802399.870712:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f1e00/0x6ecba1490fc9ceb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ceb7 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802399.870720:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f1e00/0x6ecba1490fc9ceb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9ceb7 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788802399.871426:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788802399.872274:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788802399.872532:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788802399.872578:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788802399.872612:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788802399.872674:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788802399.872716:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788802399.872751:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788802399.872818:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788802399.872827:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788802399.872905:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892182912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788802399.872962:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802399.873327:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802399.873418:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892182912 00000100:00100000:1.0:1788802399.873425:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892182912 00000100:00100000:2.0:1788802399.873602:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788802399.873622:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+14:15036:x1875694892182912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802399.874070:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+14:15036:x1875694892182912:12345-0@lo:501:mount.lustre.0 Request processed in 450us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802399.874077:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788802399.874167:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892182912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788802399.874204:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788802399.874287:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802399.874313:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802399.874431:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892183040 00000100:00100000:1.0:1788802399.874436:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892183040 00000100:00100000:1.0:1788802399.874460:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788802399.874466:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+14:15036:x1875694892183040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788802399.874771:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+14:15036:x1875694892183040:12345-0@lo:503:mount.lustre.0 Request processed in 304us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802399.874779:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788802399.874898:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183040:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788802399.875570:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788802399.875637:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788802399.875687:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802399.875717:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802399.875860:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892183168 00000100:00100000:1.0:1788802399.875866:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892183168 00000100:00100000:1.0:1788802399.875945:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788802399.875954:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+14:15036:x1875694892183168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788802399.876185:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+14:15036:x1875694892183168:12345-0@lo:502:mount.lustre.0 Request processed in 231us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802399.876193:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788802399.876386:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788802399.876622:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788802399.876670:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788802399.876705:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788802399.876765:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788802399.876797:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788802399.876824:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788802399.876887:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788802399.876928:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788802399.876961:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788802399.877114:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788802399.877154:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788802399.877201:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788802399.877273:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788802399.877325:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802399.877361:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08b750c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802399.877434:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892183296 00000100:00100000:2.0:1788802399.877441:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892183296 00000100:00100000:2.0:1788802399.877621:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788802399.877631:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+14:15036:x1875694892183296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788802399.877812:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+14:15036:x1875694892183296:12345-0@lo:502:mount.lustre.0 Request processed in 183us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802399.877820:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788802399.877937:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183296:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788802399.878106:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788802399.878118:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788802399.881764:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788802399.881779:0:15050:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788802399.881787:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802399.881789:0:15050:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788802399.881796:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788802399.881832:0:15050:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff910d25064d40) 00000020:00000080:0.0:1788802399.881856:0:15050:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788802399.881865:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788802399.881950:0:15050:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d030ff000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788802399.881958:0:15050:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788802399.881964:0:15050:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6ecba1490fc9cec5 00010000:00010000:0.0:1788802399.888795:0:15050:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788802399.889578:0:15050:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788802399.892200:0:15050:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788802399.897373:0:15050:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788802399.897387:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802399.897393:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802399.897395:0:15050:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788802399.897398:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788802399.897406:0:15050:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788802399.897408:0:15050:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788802399.897409:0:15050:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788802399.897411:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788802399.897414:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802399.897415:0:15050:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788802399.897417:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788802399.897420:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802399.897421:0:15050:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788802399.897424:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788802399.897425:0:15050:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788802399.897428:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802399.897430:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802399.897431:0:15050:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788802399.897433:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788802399.897435:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802399.897436:0:15050:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788802399.897439:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788802399.897504:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788802399.897507:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788802399.897508:0:15050:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788802399.897512:0:15050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788802399.897954:0:15036:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788802399.899108:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788802399.899134:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1e00/0x6ecba1490fc9ceb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ceb7 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802399.899147:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f1e00/0x6ecba1490fc9ceb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ceb7 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802399.899157:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d030ff000 from 1 10000000:01000000:2.0:1788802399.899160:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788802399.899196:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802399.899205:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802399.899217:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802399.899269:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788802399.899342:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802399.899383:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1e3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788802399.899415:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892183424 00000100:00100000:2.0:1788802399.899422:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892183424 00000100:00100000:2.0:1788802399.899466:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788802399.899474:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+14:15036:x1875694892183424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788802399.899487:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802399.899499:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ced3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9cecc expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802399.899523:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ced3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9cecc expref: 15 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802399.899535:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ced3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9cecc expref: 15 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802399.899544:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216ee00, rc 0) 00000100:00100000:2.0:1788802399.899579:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+15:15036:x1875694892183424:12345-0@lo:101:mount.lustre.0 Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802399.899585:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788802399.899632:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788802399.899647:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802399.899656:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788802399.901126:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788802399.901607:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788802399.901859:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788802399.901905:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788802399.901974:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788802399.901984:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788802399.902066:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802399.902134:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802399.902180:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1e3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788802399.902380:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892183552 00000100:00100000:3.0:1788802399.902388:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892183552 00000100:00100000:3.0:1788802399.902433:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788802399.902443:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+15:15036:x1875694892183552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788802399.902682:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+15:15036:x1875694892183552:12345-0@lo:501:mount.lustre.0 Request processed in 240us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.902690:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788802399.903139:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802399.903176:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788802399.903215:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802399.903320:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788802399.903462:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892183680 00000100:00100000:1.0:1788802399.903468:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892183680 00000100:00100000:1.0:1788802399.903545:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788802399.903554:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+15:15036:x1875694892183680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788802399.903714:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+15:15036:x1875694892183680:12345-0@lo:503:mount.lustre.0 Request processed in 161us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802399.903721:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788802399.903794:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183680:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788802399.904342:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788802399.904421:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788802399.904468:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802399.904721:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d038adc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802399.904805:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892183808 00000100:00100000:3.0:1788802399.904811:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892183808 00000100:00100000:3.0:1788802399.904837:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788802399.904844:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+15:15036:x1875694892183808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788802399.905022:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+15:15036:x1875694892183808:12345-0@lo:502:mount.lustre.0 Request processed in 178us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.905029:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788802399.905176:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788802399.905438:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788802399.905489:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788802399.905545:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788802399.905597:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788802399.905635:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788802399.905684:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788802399.905733:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788802399.905770:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788802399.905800:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788802399.905842:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802399.905858:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d038adc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788802399.905934:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892183936 00000100:00100000:3.0:1788802399.905940:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892183936 00000100:00100000:3.0:1788802399.905969:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788802399.905988:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+15:15036:x1875694892183936:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788802399.906145:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+15:15036:x1875694892183936:12345-0@lo:502:mount.lustre.0 Request processed in 168us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.906153:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788802399.906356:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892183936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788802399.906434:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788802399.906444:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788802399.907285:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802399.907296:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802399.907299:0:15054:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788802399.907306:0:15054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d030ff000 00000020:00000080:2.0:1788802399.907308:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788802399.907315:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802399.907317:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802399.907318:0:15054:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788802399.907321:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802399.907323:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802399.907324:0:15054:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788802399.907328:0:15054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d030ff000 00000020:00000080:2.0:1788802399.907329:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788802399.907385:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802399.907389:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802399.907390:0:15054:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788802399.907393:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802399.907395:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802399.907397:0:15054:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788802399.907400:0:15054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910d030ff000 00000020:00000080:2.0:1788802399.907402:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788802399.907435:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802399.907439:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802399.907440:0:15054:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788802399.907449:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788802399.907565:0:15036:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788802399.907591:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788802399.907616:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.907629:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802399.907670:0:15036:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788802399.907673:0:15036:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910d030ff000 10000000:01000000:3.0:1788802399.907676:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910d030ff000 10000000:01000000:3.0:1788802399.907680:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788802399.907685:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d030ff000 from 1 10000000:01000000:3.0:1788802399.907688:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788802399.907720:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee8a00/0x6ecba1490fc9ceda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.907729:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3eee8a00/0x6ecba1490fc9ceda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.907740:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3eee8a00/0x6ecba1490fc9ceda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802399.907760:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788802399.907819:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802399.907853:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788802399.907870:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892184064 00000100:00100000:3.0:1788802399.907876:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892184064 00000100:00100000:3.0:1788802399.907908:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788802399.907916:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+15:15036:x1875694892184064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788802399.907927:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802399.907939:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9cee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9ceda expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.907961:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9cee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9ceda expref: 16 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.907972:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee8c00/0x6ecba1490fc9cee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ceda expref: 16 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.908067:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8c00, rc 0) 00000100:00100000:3.0:1788802399.908102:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184064:12345-0@lo:101:mount.lustre.0 Request processed in 186us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.908109:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788802399.908153:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788802399.908166:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3eee8a00/0x6ecba1490fc9ceda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cee1 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.908174:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3eee8a00/0x6ecba1490fc9ceda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9cee1 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788802399.908732:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788802399.916079:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788802399.916407:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788802399.916454:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788802399.916488:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788802399.916535:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788802399.916571:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788802399.916620:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788802399.916659:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788802399.916692:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788802399.916773:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788802399.916811:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788802399.916843:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788802399.916891:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788802399.916929:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788802399.916961:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788802399.920222:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788802399.920313:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788802399.920348:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788802399.920392:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788802399.920423:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788802399.920453:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788802399.920497:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788802399.920532:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788802399.920561:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788802399.920600:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788802399.920648:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788802399.920682:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788802399.920731:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788802399.920767:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788802399.920851:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788802399.920859:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788802399.920965:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802399.923434:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802399.923481:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d038adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802399.924096:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892184192 00000100:00100000:3.0:1788802399.924106:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892184192 00000100:00100000:3.0:1788802399.924164:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788802399.924173:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788802399.924562:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184192:12345-0@lo:501:mount.lustre.0 Request processed in 388us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.924570:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788802399.926114:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802399.926174:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788802399.926231:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802399.926290:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d038adcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802399.927130:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892184320 00000100:00100000:1.0:1788802399.927141:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892184320 00000100:00100000:1.0:1788802399.927203:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788802399.927213:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788802399.927465:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184320:12345-0@lo:503:mount.lustre.0 Request processed in 253us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802399.927473:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788802399.927610:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184320:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788802399.928180:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788802399.928281:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788802399.928327:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802399.928355:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d038adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788802399.928539:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892184448 00000100:00100000:3.0:1788802399.928544:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892184448 00000100:00100000:3.0:1788802399.928579:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788802399.928585:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184448:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788802399.928792:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184448:12345-0@lo:502:mount.lustre.0 Request processed in 207us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.928800:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788802399.933299:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788802399.933617:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788802399.933680:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788802399.933714:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788802399.933769:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788802399.933807:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788802399.933851:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788802399.933884:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788802399.933915:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788802399.934070:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788802399.934110:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788802399.934138:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788802399.934182:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788802399.934217:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788802399.934279:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788802399.934325:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788802399.934368:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788802399.934398:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788802399.934442:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788802399.934477:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788802399.934507:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788802399.934551:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788802399.934584:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788802399.934613:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788802399.934654:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788802399.934705:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788802399.934742:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788802399.934789:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788802399.934825:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788802399.934855:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788802399.934896:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788802399.934928:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788802399.934960:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788802399.937173:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788802399.937276:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788802399.937319:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788802399.937371:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788802399.937406:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788802399.937439:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788802399.937494:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788802399.937533:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788802399.937587:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788802399.937670:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802399.937716:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892184576 00000100:00100000:2.0:1788802399.937724:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892184576 00000100:00100000:2.0:1788802399.937774:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788802399.937784:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788802399.940179:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184576:12345-0@lo:502:mount.lustre.0 Request processed in 2386us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802399.940196:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788802399.940303:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d038adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802399.940332:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788802399.940472:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788802399.940487:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788802399.944557:0:15059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788802399.944576:0:15059:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff910d34368000) 00000020:00000080:3.0:1788802399.944602:0:15059:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788802399.944698:0:15059:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d030ff000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788802399.944703:0:15059:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910d030ff000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788802399.944706:0:15059:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d030ff000 3 00010000:00080000:3.0:1788802399.944738:0:15059:0:(ldlm_lib.c:102:import_set_conn()) imp ffff910d040df000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.157@tcp at head 00010000:00010000:3.0:1788802399.948368:0:15059:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788802399.951096:0:15059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788802399.951138:0:15059:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788802399.951151:0:15059:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6ecba1490fc9ceef 00000100:00080000:3.0:1788802399.951161:0:15059:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788802399.951174:0:15059:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff910d040df000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788802399.951209:0:15059:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910c02fa7100 x1875694892184704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788802399.951272:0:15059:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788802399.951293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788802399.951298:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788802399.951301:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788802399.951304:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788802399.951347:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892184832:0@lo:400:kworker.0 00000100:00100000:3.0:1788802399.951410:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802399.951464:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892184832 00000100:00100000:3.0:1788802399.951471:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892184832 00000100:00100000:3.0:1788802399.951512:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788802399.951521:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892184832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802399.951571:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892184832:12345-0@lo:400:kworker.0 Request processed in 51us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.951578:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788802399.951615:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910c02fa6300 x1875694892184832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802399.951627:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892184832:0@lo:400:kworker.0 00000100:00100000:2.0:1788802399.951780:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875694892184704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788802399.951812:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802399.951901:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892184704 00000100:00100000:3.0:1788802399.951906:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892184704 00000100:00100000:3.0:1788802399.951964:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788802399.951968:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875694892184704:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788802399.951999:0:14355:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:3.0:1788802399.952036:0:14355:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6ecba1490fc9cef6 00000004:00100000:3.0:1788802399.952073:0:14355:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788802399.952105:0:14355:0:(import.c:65:import_set_state_nolock()) ffff910d33f98800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802399.952143:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875694892184704:12345-0@lo:38:llog_process_th.0 Request processed in 173us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.952150:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788802399.952884:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff910c02fa7100 x1875694892184704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788802409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802399.952895:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788802399.952902:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788802399.952910:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788802399.952915:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788802399.952917:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d040df000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788802399.952923:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875694892184704:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788802399.956364:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788802399.959105:0:15036:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788802399.959149:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788802399.959180:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee8a00/0x6ecba1490fc9ceda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cee1 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.959193:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3eee8a00/0x6ecba1490fc9ceda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cee1 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788802399.959270:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788802399.959273:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788802399.959274:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788802399.959275:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788802399.959277:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788802399.959278:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788802399.959280:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788802399.959288:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788802399.959289:0:15036:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788802399.959293:0:15036:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788802399.959295:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788802399.959296:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788802399.959297:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788802399.959298:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788802399.959299:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788802399.959300:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788802399.959301:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788802399.959302:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788802399.959302:0:15036:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788802399.959329:0:15036:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788802399.959350:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184960:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788802399.959417:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802399.959463:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d0337d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788802399.959586:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892184960 00000100:00100000:1.0:1788802399.959594:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892184960 00000100:00100000:1.0:1788802399.959742:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788802399.959753:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184960:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788802399.959779:0:14346:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788802399.959792:0:14346:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788802399.986673:0:14346:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788802399.986722:0:14346:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788802399.991722:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+16:15036:x1875694892184960:12345-0@lo:253:mount.lustre.0 Request processed in 31961us (32294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.991739:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788802399.991851:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15036:1875694892184960:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788802399.991868:0:15036:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788802399.991871:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788802399.991873:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788802399.991874:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788802399.991876:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788802399.991877:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788802399.991878:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788802399.991880:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788802399.991881:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788802399.991883:0:15036:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788802399.991897:0:15036:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788802399.995329:0:14369:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788802399.995340:0:14369:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788802399.995421:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.995442:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3eee8600/0x6ecba1490fc9ce6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce63 expref: 15 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.995451:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.995494:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3eee8600/0x6ecba1490fc9ce6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9ce63 expref: 15 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.995510:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d3eee8600/0x6ecba1490fc9ce6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce63 expref: 15 pid: 14348 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802399.995525:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14369:1875694892185088:0@lo:104: 00000100:00100000:1.0:1788802399.995591:0:14369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802399.995644:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef26600 going to sleep for 11 seconds 00000100:00100000:3.0:1788802399.995737:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892185088 00000100:00100000:3.0:1788802399.995745:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892185088 00000100:00100000:3.0:1788802399.995799:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788802399.995809:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:87cc913b-814f-413d-b622-408baef57c45+3:14369:x1875694892185088:12345-0@lo:104: 00010000:00010000:3.0:1788802399.995823:0:14337:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802399.995879:0:14337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788802399.995885:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:87cc913b-814f-413d-b622-408baef57c45+3:14369:x1875694892185088:12345-0@lo:104: Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802399.995891:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788802399.995949:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802399.995956:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.995965:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1800 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:1.0:1788802399.995969:0:14341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.995989:0:14341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788802399.995997:0:14341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788802399.996004:0:14341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788802399.996036:0:14341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996043:0:14341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788802399.996075:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996082:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d206f1800/0x6ecba1490fc9ce63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce6a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996099:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802399.996101:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802399.996102:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802399.996117:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87cc913b-814f-413d-b622-408baef57c45:3313:1875694892185216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788802399.996146:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802399.996192:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892185216 00000100:00100000:1.0:1788802399.996197:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892185216 00010000:00010000:1.0:1788802399.996215:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3eee8600/0x6ecba1490fc9ce6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce63 expref: 16 pid: 14348 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802399.996234:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788802399.996275:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87cc913b-814f-413d-b622-408baef57c45+16:3313:x1875694892185216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802399.996285:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802399.996290:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3eee8600/0x6ecba1490fc9ce6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce63 expref: 16 pid: 14348 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996300:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3eee8600/0x6ecba1490fc9ce6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce63 expref: 16 pid: 14348 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996315:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996323:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788802399.996336:0:14340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001589933s 00010000:00010000:1.0:1788802399.996341:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996349:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996356:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996363:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996381:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802399.996385:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996394:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996402:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996412:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802399.996439:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87cc913b-814f-413d-b622-408baef57c45+16:3313:x1875694892185216:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802399.996445:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788802399.996491:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87cc913b-814f-413d-b622-408baef57c45:3313:1875694892185216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802399.996515:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3eee8600/0x6ecba1490fc9ce6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9ce63 expref: 15 pid: 14348 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802399.996524:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14369:1875694892185088:0@lo:104: 00010000:00010000:1.0:1788802399.996534:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996542:0:14369:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996549:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802399.996565:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9cefd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788802399.999039:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788802399.999223:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788802399.999468:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788802399.999633:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788802399.999803:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788802400.000021:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788802400.001172:0:15036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788802400.043613:0:15036:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788802400.043624:0:15036:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788802400.043667:0:15036:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788802400.043728:0:15036:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788802400.043743:0:15036:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788802400.043771:0:15036:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788802400.845346:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788802401.171090:0:14350:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788802401.171099:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff910d3f90d800 from 7 10000000:01000000:0.0:1788802401.171104:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788802401.171154:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802401.171167:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802401.171178:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802401.171221:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892185344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788802401.171307:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802401.171358:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d03caf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802401.175669:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892185344 00000100:00100000:2.0:1788802401.175681:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892185344 00000100:00100000:2.0:1788802401.175878:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788802401.175889:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+15:14350:x1875694892185344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802401.175906:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802401.175925:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9cf0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9cf04 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802401.175952:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9cf0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9cf04 expref: 16 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802401.175964:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9cf0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9cf04 expref: 16 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802401.175972:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216e000, rc 0) 00000100:00100000:2.0:1788802401.176058:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+16:14350:x1875694892185344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802401.176065:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788802401.176133:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892185344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802401.176151:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802401.176161:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802401.176223:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892185472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788802401.176285:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802401.176314:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d21444d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788802401.176329:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892185472 00000100:00100000:2.0:1788802401.176333:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892185472 00000100:00100000:2.0:1788802401.176361:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788802401.176366:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+16:14350:x1875694892185472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788802401.176379:0:14346:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788802401.176393:0:14346:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788802401.176396:0:14346:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788802401.176468:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+16:14350:x1875694892185472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802401.176476:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788802401.176504:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892185472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788802401.176554:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788802401.176561:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802401.176569:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802401.869338:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802402.894419:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802403.925147:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802404.940689:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788802405.260618:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788802405.260627:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788802405.260630:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788802405.260633:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788802405.260687:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892185728:0@lo:400:kworker.0 00000100:00100000:1.0:1788802405.260757:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802405.260819:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788802405.260825:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892185856:0@lo:400:kworker.0 00000100:00100000:1.0:1788802405.260850:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802405.260998:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788802405.261009:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87cc913b-814f-413d-b622-408baef57c45:3313:1875694892185600:0@lo:400:kworker.0 00000100:00100000:0.0:1788802405.261048:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802405.261084:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892185600 00000100:00100000:0.0:1788802405.261091:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892185600 00000100:00100000:0.0:1788802405.261139:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788802405.261148:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+16:3313:x1875694892185600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802405.261199:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+16:3313:x1875694892185600:12345-0@lo:400:kworker.0 Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802405.261206:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788802405.261290:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87cc913b-814f-413d-b622-408baef57c45:3313:1875694892185600:0@lo:400:kworker.0 00000100:00100000:1.0:1788802405.261605:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892185728 00000100:00100000:1.0:1788802405.261610:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892185728 00000100:00100000:1.0:1788802405.261679:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892185856 00000100:00100000:1.0:1788802405.261682:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892185856 00000100:00080000:0.0:1788802405.261753:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802405.268392:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788802405.268418:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892185728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802405.268531:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892185728:12345-0@lo:400:kworker.0 Request processed in 126us (7773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802405.268539:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788802405.268566:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788802405.268573:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892185856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802405.268602:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892185856:12345-0@lo:400:kworker.0 Request processed in 30us (7751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802405.268607:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788802405.268658:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d3a18c700 x1875694892185856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802405.268674:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892185856:0@lo:400:kworker.0 00010000:00080000:3.0:1788802405.268687:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d3a18f100 x1875694892185728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802405.268696:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892185728:0@lo:400:kworker.0 00010000:00010000:3.0:1788802405.964530:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788802406.371928:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788802406.767409:0:15404:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788802406.988399:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802408.013488:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802409.038761:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.061411:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802410.190151:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788802395/real 1788802395] req@ffff910d3fad4000 x1875694892181632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788802410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802410.190183:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910d3fad4000 x1875694892181632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788802410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802410.190193:0:3310:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788802395/real 1788802395] req@ffff910d3fad4380 x1875694892181760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788802410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802410.190204:0:3310:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff910d3fad4380 x1875694892181760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788802410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788802410.190220:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d08d99800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788802410.190332:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788802410.190337:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892181632:0@lo:8:kworker.0 00000100:00080000:2.0:1788802410.190343:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3382b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788802410.198095:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788802410.198103:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788802410.198108:0:38:0:(import.c:65:import_set_state_nolock()) ffff910d08d99800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788802410.198126:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1788802410.198133:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788802410.198146:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff910d08d99800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788802410.198156:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788802410.198176:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892185984:0@lo:400:kworker.0 00000100:00100000:3.0:1788802410.198268:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802410.198302:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892185984 00000100:00100000:0.0:1788802410.198311:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892185984 00000100:00100000:3.0:1788802410.198339:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910c02fa6a00 x1875694892186112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788802410.198351:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788802410.198354:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788802410.198356:0:38:0:(import.c:65:import_set_state_nolock()) ffff910d3382b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788802410.198357:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788802410.198359:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1788802410.198362:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1788802410.198365:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+16:3314:x1875694892185984:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788802410.198367:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910d3382b800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788802410.198378:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910c02fa5c00 x1875694892186240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788802410.198405:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892186368:0@lo:400:kworker.0 00000100:00100000:0.0:1788802410.198414:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+16:3314:x1875694892185984:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802410.198421:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788802410.198428:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802410.198463:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892185984:0@lo:400:kworker.0 00000100:00100000:3.0:1788802410.198522:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802410.198530:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875694892186496:0@lo:400:kworker.0 00000100:00100000:3.0:1788802410.198553:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802410.198577:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892186368 00000100:00100000:3.0:1788802410.198581:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892186368 00000100:00100000:3.0:1788802410.198606:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892186496 00000100:00100000:3.0:1788802410.198615:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892186496 00000100:00100000:3.0:1788802410.198641:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788802410.198647:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892186368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802410.198683:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875694892186368:12345-0@lo:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802410.198690:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788802410.198701:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788802410.198707:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875694892186496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802410.198733:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875694892186496:12345-0@lo:400:kworker.0 Request processed in 26us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802410.198738:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788802410.198762:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910c02fa5180 x1875694892186368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802410.198773:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875694892186368:0@lo:400:kworker.0 00010000:00080000:3.0:1788802410.198796:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910c02fa6300 x1875694892186496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802410.198805:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875694892186496:0@lo:400:kworker.0 00000100:00080000:0.0:1788802410.199124:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788802410.201110:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788802410.201122:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892181760:0@lo:8:kworker.0 00000100:00100000:0.0:1788802410.212549:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892186112:0@lo:8:kworker.0 00000100:00100000:0.0:1788802410.212646:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802410.212691:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892186240:0@lo:8:kworker.0 00000100:00100000:0.0:1788802410.212711:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802410.212804:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892186112 00000100:00100000:1.0:1788802410.212815:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892186112 00000100:00100000:1.0:1788802410.212858:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892186240 00000100:00100000:1.0:1788802410.212861:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892186240 00000100:00100000:1.0:1788802410.212884:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802410.212894:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875694892186112:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788802410.212928:0:15038:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:1.0:1788802410.212964:0:15038:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6ecba1490fc9cf12 00002000:00100000:1.0:1788802410.212980:0:15038:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff910d037cb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788802410.212984:0:15038:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788802410.212987:0:15038:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788802410.213679:0:15038:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788802410.213710:0:15038:0:(import.c:65:import_set_state_nolock()) ffff910d037cd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788802410.213788:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875694892186112:12345-0@lo:8:kworker.0 Request processed in 894us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802410.213796:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802410.213820:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788802410.213824:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875694892186240:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788802410.213836:0:15038:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788802410.213864:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875694892186240:12345-0@lo:8:kworker.0 Request processed in 38us (1152us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788802410.213881:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788802410.214060:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910c02fa6a00 x1875694892186112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788802430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802410.214071:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788802410.214079:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788802410.214087:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788802410.214092:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788802410.214094:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d08d99800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788802410.214114:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788802410.214120:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892186112:0@lo:8:kworker.0 00000100:00080000:2.0:1788802410.214136:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3382b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788802410.214140:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788802410.214143:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892186240:0@lo:8:kworker.0 00000004:00080000:0.0:1788802410.214272:0:14375:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788802410.214687:0:14375:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 463161447601ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788802410.216339:0:14376:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788802410.216369:0:14376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14376:1875694892186752:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788802410.216437:0:14376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802410.216468:0:14376:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d15be7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788802410.216489:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892186624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802410.216515:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802410.221357:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892186624 00000100:00100000:3.0:1788802410.221372:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892186624 00000100:00100000:1.0:1788802410.221398:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892186752 00000100:00100000:1.0:1788802410.221403:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892186752 00000100:00100000:3.0:1788802410.221441:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802410.221445:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788802410.221451:0:15041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875694892186624:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802410.221451:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14376:x1875694892186752:12345-0@lo:5:osp-pre-0-0.0 00002000:00000024:3.0:1788802410.221486:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802410.221554:0:15041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875694892186624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (5037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802410.221560:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788802410.224603:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788802410.225335:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d3a18ce00 x1875694892186624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802410.225367:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892186624:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788802410.226782:0:15037:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788802410.226793:0:15037:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788802410.226798:0:15037:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1788802410.251985:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.251999:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.252448:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.252454:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.252462:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.252484:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.252495:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.252505:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.252549:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788802410.252564:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802410.252571:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.252588:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802410.252593:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.252603:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.252622:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.252631:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.253374:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802410.253378:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802410.253380:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788802410.264926:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.264947:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5e9a628/0x6ecba1490fc9cf20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.264966:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.264971:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.264978:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5e9a628/0x6ecba1490fc9cf20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.264995:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5e9a628/0x6ecba1490fc9cf20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.265006:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5e9a628/0x6ecba1490fc9cf20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.265014:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5e9a628/0x6ecba1490fc9cf20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.265060:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788802410.265965:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.265973:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011980819/0x6ecba1490fc9cf27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.265982:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.265985:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.265990:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011980819/0x6ecba1490fc9cf27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.266001:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011980819/0x6ecba1490fc9cf27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.266009:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011980819/0x6ecba1490fc9cf27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.266016:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011980819/0x6ecba1490fc9cf27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.266035:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788802410.266774:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.266784:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cf2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.266794:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.266803:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.266808:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cf2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.266819:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cf2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.266827:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cf2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.266835:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cf2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.266844:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788802410.268457:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.268469:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cf35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.268482:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.268486:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.268491:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cf35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.268503:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cf35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.268512:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cf35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.268526:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cf35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.268535:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788802410.268811:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788802410.268819:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5e9a628/0x6ecba1490fc9cf20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268829:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0000 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802410.268834:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5e9a628/0x6ecba1490fc9cf20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268843:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5e9a628/0x6ecba1490fc9cf20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268884:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5e9a628/0x6ecba1490fc9cf20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268892:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5e9a628/0x6ecba1490fc9cf20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268912:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788802410.268915:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011980819/0x6ecba1490fc9cf27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268921:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802410.268924:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011980819/0x6ecba1490fc9cf27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268932:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011980819/0x6ecba1490fc9cf27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268942:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011980819/0x6ecba1490fc9cf27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268950:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011980819/0x6ecba1490fc9cf27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268961:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788802410.268965:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cf2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268978:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802410.268982:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cf2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.268990:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cf2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.269000:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cf2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.269007:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cf2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.269019:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802410.269022:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cf35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.269028:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802410.269031:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cf35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.269036:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cf35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.269044:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cf35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.269054:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cf35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.269066:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802410.269068:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802410.269070:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.269226:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788802410.269968:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.269978:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cf3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.269991:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.269995:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.270000:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cf3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.270011:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cf3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.270020:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cf3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.270028:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cf3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.270050:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788802410.270565:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.270571:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cf43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.270586:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.270590:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.270594:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cf43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.270604:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cf43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.270612:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cf43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.270619:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cf43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.270639:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788802410.270680:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788802410.270687:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cf3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.270696:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.270700:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cf3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.270719:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cf3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.270738:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cf3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.270746:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cf3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.270766:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802410.270770:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cf43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.270777:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1800 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.270780:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cf43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.270788:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cf43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.270798:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cf43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.270805:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cf43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.270826:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.270828:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.270830:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788802410.271021:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.271027:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cf4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.271035:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.271038:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.271042:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cf4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.271052:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cf4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.271060:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.271070:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cf4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.271078:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cf4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.271098:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788802410.271147:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802410.271152:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cf4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.271159:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.271162:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cf4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.271169:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cf4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.271180:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cf4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.271188:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cf4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.271201:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.271203:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.271205:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788802410.274521:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.274533:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cf51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.274550:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.274555:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.274561:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cf51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.274576:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cf51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.274586:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cf51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.274594:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cf51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.274623:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788802410.277697:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788802410.277710:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cf51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.277724:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802410.277729:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cf51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.277741:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cf51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.277762:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cf51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.277770:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cf51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.277792:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802410.277794:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802410.277802:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788802410.279835:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.279849:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831061bb/0x6ecba1490fc9cf58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.279866:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.279980:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.279987:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000831061bb/0x6ecba1490fc9cf58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.280004:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000831061bb/0x6ecba1490fc9cf58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.280015:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000831061bb/0x6ecba1490fc9cf58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.280023:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000831061bb/0x6ecba1490fc9cf58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.280052:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788802410.280152:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802410.280159:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000831061bb/0x6ecba1490fc9cf58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.280167:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802410.280171:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000831061bb/0x6ecba1490fc9cf58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.280179:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000831061bb/0x6ecba1490fc9cf58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.280195:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000831061bb/0x6ecba1490fc9cf58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.280203:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000831061bb/0x6ecba1490fc9cf58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.280221:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.280223:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.280225:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788802410.281781:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000004:00080000:3.0:1788802410.282094:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788802410.285091:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.285122:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.285127:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.285135:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.285171:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.285183:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.285192:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.285222:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788802410.285281:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802410.285289:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.285297:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802410.285308:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.285316:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.285332:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.285339:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f630ccd6/0x6ecba1490fc9cf5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.285359:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.285361:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.285362:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788802410.286767:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.286778:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000973bc687/0x6ecba1490fc9cf66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.286792:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.287232:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.288533:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000973bc687/0x6ecba1490fc9cf66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.288555:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000973bc687/0x6ecba1490fc9cf66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.288567:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000973bc687/0x6ecba1490fc9cf66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.288585:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000973bc687/0x6ecba1490fc9cf66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.288602:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788802410.291300:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788802410.291314:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000973bc687/0x6ecba1490fc9cf66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.291329:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802410.291334:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000973bc687/0x6ecba1490fc9cf66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.291346:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000973bc687/0x6ecba1490fc9cf66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.291372:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000973bc687/0x6ecba1490fc9cf66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.291381:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000973bc687/0x6ecba1490fc9cf66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.291407:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802410.291408:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802410.291410:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788802410.292444:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.292456:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f2f2c63/0x6ecba1490fc9cf6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.292471:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.292475:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.292482:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f2f2c63/0x6ecba1490fc9cf6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.292496:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f2f2c63/0x6ecba1490fc9cf6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.292505:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f2f2c63/0x6ecba1490fc9cf6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.292514:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f2f2c63/0x6ecba1490fc9cf6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.292542:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788802410.292910:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802410.292918:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f2f2c63/0x6ecba1490fc9cf6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.292926:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3800 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802410.292931:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f2f2c63/0x6ecba1490fc9cf6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.292940:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f2f2c63/0x6ecba1490fc9cf6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.292954:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f2f2c63/0x6ecba1490fc9cf6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.292968:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f2f2c63/0x6ecba1490fc9cf6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.292986:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.292988:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.292989:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788802410.296494:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.296511:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cea050c/0x6ecba1490fc9cf74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.296536:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.296541:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.296548:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cea050c/0x6ecba1490fc9cf74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.296563:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cea050c/0x6ecba1490fc9cf74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.296572:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cea050c/0x6ecba1490fc9cf74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.296580:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cea050c/0x6ecba1490fc9cf74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.296607:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788802410.297264:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788802410.297277:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cea050c/0x6ecba1490fc9cf74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.297287:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3e00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802410.297292:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cea050c/0x6ecba1490fc9cf74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.297315:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cea050c/0x6ecba1490fc9cf74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.297333:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cea050c/0x6ecba1490fc9cf74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.297341:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cea050c/0x6ecba1490fc9cf74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.297364:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802410.297366:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802410.297368:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788802410.297471:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.297477:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0b795/0x6ecba1490fc9cf7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.297486:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.297490:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.297495:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0b795/0x6ecba1490fc9cf7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.297505:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acd0b795/0x6ecba1490fc9cf7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.297523:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acd0b795/0x6ecba1490fc9cf7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.297530:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acd0b795/0x6ecba1490fc9cf7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.297548:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788802410.297903:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802410.297910:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acd0b795/0x6ecba1490fc9cf7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.297929:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.297933:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0b795/0x6ecba1490fc9cf7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.297941:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acd0b795/0x6ecba1490fc9cf7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.297953:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acd0b795/0x6ecba1490fc9cf7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.297960:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acd0b795/0x6ecba1490fc9cf7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.297975:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.297977:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.297978:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788802410.298435:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.298444:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9cf82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.298452:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.298456:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.298460:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9cf82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.298469:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9cf82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.298478:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9cf82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.298486:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9cf82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.298514:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788802410.298920:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802410.298927:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9cf82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.298936:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2e00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.298941:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9cf82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.298950:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9cf82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.298969:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9cf82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.298976:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1981f54/0x6ecba1490fc9cf82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.298991:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.298993:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.298995:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788802410.299405:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.299413:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000071d7ff2/0x6ecba1490fc9cf89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.299423:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.299426:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.299431:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000071d7ff2/0x6ecba1490fc9cf89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.299441:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000071d7ff2/0x6ecba1490fc9cf89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.299449:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000071d7ff2/0x6ecba1490fc9cf89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.299457:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000071d7ff2/0x6ecba1490fc9cf89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.299480:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788802410.301084:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802410.301098:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000071d7ff2/0x6ecba1490fc9cf89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.301111:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3000 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.301117:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000071d7ff2/0x6ecba1490fc9cf89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.301127:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000071d7ff2/0x6ecba1490fc9cf89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.301150:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000071d7ff2/0x6ecba1490fc9cf89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.301157:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000071d7ff2/0x6ecba1490fc9cf89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.301193:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.301195:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.301197:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788802410.301687:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.301696:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2fd56a1/0x6ecba1490fc9cf90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.301706:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.301716:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.301722:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2fd56a1/0x6ecba1490fc9cf90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.301733:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2fd56a1/0x6ecba1490fc9cf90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.301742:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2fd56a1/0x6ecba1490fc9cf90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.301749:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2fd56a1/0x6ecba1490fc9cf90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.301776:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788802410.302381:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802410.302388:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2fd56a1/0x6ecba1490fc9cf90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.302397:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802410.302401:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2fd56a1/0x6ecba1490fc9cf90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.302408:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2fd56a1/0x6ecba1490fc9cf90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.302423:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2fd56a1/0x6ecba1490fc9cf90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.302430:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2fd56a1/0x6ecba1490fc9cf90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.302447:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.302449:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.302450:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788802410.304528:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.304540:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049bb91d6/0x6ecba1490fc9cf97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.304557:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.304562:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.304568:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049bb91d6/0x6ecba1490fc9cf97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.304582:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049bb91d6/0x6ecba1490fc9cf97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.304593:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049bb91d6/0x6ecba1490fc9cf97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.304606:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049bb91d6/0x6ecba1490fc9cf97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.304623:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788802410.305175:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.305182:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d098f0cb/0x6ecba1490fc9cf9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.305191:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.305194:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.305199:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d098f0cb/0x6ecba1490fc9cf9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.305208:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d098f0cb/0x6ecba1490fc9cf9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.305216:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d098f0cb/0x6ecba1490fc9cf9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.305222:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d098f0cb/0x6ecba1490fc9cf9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.305234:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788802410.305615:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788802410.305621:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f3519c/0x6ecba1490fc9cfa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.305634:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788802410.305637:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788802410.305641:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f3519c/0x6ecba1490fc9cfa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.305650:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f3519c/0x6ecba1490fc9cfa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.305658:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f3519c/0x6ecba1490fc9cfa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.305664:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f3519c/0x6ecba1490fc9cfa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802410.305671:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788802410.306128:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788802410.306135:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049bb91d6/0x6ecba1490fc9cf97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306143:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3a00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.306147:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049bb91d6/0x6ecba1490fc9cf97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306156:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049bb91d6/0x6ecba1490fc9cf97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306172:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049bb91d6/0x6ecba1490fc9cf97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306179:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049bb91d6/0x6ecba1490fc9cf97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306196:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788802410.306199:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d098f0cb/0x6ecba1490fc9cf9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306204:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.306214:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d098f0cb/0x6ecba1490fc9cf9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306221:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d098f0cb/0x6ecba1490fc9cf9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306230:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d098f0cb/0x6ecba1490fc9cf9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306251:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d098f0cb/0x6ecba1490fc9cf9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306264:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802410.306267:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f3519c/0x6ecba1490fc9cfa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306273:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2a00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.306276:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f3519c/0x6ecba1490fc9cfa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306282:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f3519c/0x6ecba1490fc9cfa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306291:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f3519c/0x6ecba1490fc9cfa5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306297:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f3519c/0x6ecba1490fc9cfa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.306314:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.306315:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.306317:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.306421:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788802410.313468:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.313483:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9cfac lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.313502:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.313507:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.313513:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9cfac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.313528:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9cfac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.313538:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9cfac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.313547:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9cfac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.313569:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788802410.314042:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.314049:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cfb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.314058:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.314061:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.314065:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cfb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.314085:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cfb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.314094:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cfb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.314101:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cfb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.314117:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788802410.314256:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788802410.314265:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9cfac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.314273:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802410.314278:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9cfac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.314288:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9cfac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.314305:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9cfac lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.314322:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9cfac lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.314341:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788802410.314344:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cfb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.314350:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:3.0:1788802410.314353:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cfb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.314360:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cfb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.314370:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cfb3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.314376:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000900e6786/0x6ecba1490fc9cfb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802410.314388:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802410.314390:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802410.314392:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802410.314954:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788802410.319862:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.321001:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cfba lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.321021:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.321026:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.321032:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cfba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.321051:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cfba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.321061:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cfba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.321082:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cfba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.321098:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788802410.321727:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.321734:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cfc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.321744:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.321747:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.321751:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cfc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.321761:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cfc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.321768:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cfc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.321775:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cfc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.321842:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788802410.325226:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.325255:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cfc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.325280:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.325284:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.325289:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cfc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.325300:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cfc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.325308:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cfc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.325313:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cfc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.330142:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788802410.330824:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.330835:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cfcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.330851:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.330855:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.330861:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cfcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.330889:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cfcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.330911:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cfcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.330918:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cfcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.330929:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788802410.331330:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802410.331336:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cfd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.331345:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788802410.331348:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802410.331351:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cfd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.331360:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cfd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.331367:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cfd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.331373:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cfd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802410.331392:0:15037:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:0.0:1788802410.331555:0:15037:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:2.0:1788802410.331742:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788802410.331751:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cfba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331760:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1800 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.331765:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cfba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331774:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cfba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331792:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cfba lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331800:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9cfba lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331819:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788802410.331823:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cfc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331829:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.331838:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cfc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331846:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cfc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331857:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cfc1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331864:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9cfc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331889:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788802410.331893:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cfc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331899:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.331902:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cfc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331909:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cfc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331919:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cfc8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331926:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186a8507/0x6ecba1490fc9cfc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331946:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788802410.331949:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cfcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331955:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.331959:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cfcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331966:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cfcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331975:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cfcf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331981:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9cfcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331991:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802410.331994:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cfd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.331999:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802410.332002:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cfd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.332019:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cfd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.332028:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cfd6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.332035:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b6828a3/0x6ecba1490fc9cfd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802410.332048:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.332049:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802410.332051:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802410.332119:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14376:x1875694892186752:12345-0@lo:5:osp-pre-0-0.0 Request processed in 110664us (115678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802410.332133:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788802410.338185:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802410.338592:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802410.342292:0:14376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14376:1875694892186752:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788802410.342315:0:14376:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788802410.342459:0:14376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14376:1875694892186880:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788802410.342521:0:14376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802410.342580:0:14376:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08affcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802410.342641:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892186880 00000100:00100000:1.0:1788802410.342648:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892186880 00000100:00100000:1.0:1788802410.342701:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788802410.342711:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14376:x1875694892186880:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788802410.342755:0:15039:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1788802410.357053:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14376:x1875694892186880:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14336us (14525us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788802410.357075:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788802410.357671:0:14376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14376:1875694892186880:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788802410.357687:0:14376:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:1.0:1788802410.552283:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788802410.552315:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788802411.086487:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802412.110368:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802413.136500:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802414.156597:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788802415.116222:0:15755:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788802415.116227:0:15755:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788802415.116389:0:15755:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff910d0450b800 00000020:01000004:2.0:1788802415.116406:0:15755:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788802415.116420:0:15755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788802415.116434:0:15755:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff910d07c419c0) 00000020:00000080:2.0:1788802415.116451:0:15755:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788802415.145657:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788802415.145969:0:15755:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788802415.147080:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788802415.150099:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788802415.150700:0:15755:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788802415.151111:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 493: rc = 0 00100000:10000000:1.0:1788802415.151527:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 493: rc = 0 00100000:10000000:1.0:1788802415.151688:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 493: rc = 0 00100000:10000000:1.0:1788802415.152325:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 646: rc = 0 00100000:10000000:1.0:1788802415.152590:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:1.0:1788802415.152854:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 646: rc = 0 00100000:10000000:1.0:1788802415.153124:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:1.0:1788802415.153600:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 646: rc = 0 00100000:10000000:1.0:1788802415.155904:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 646: rc = 0 00000020:00000080:1.0:1788802415.156556:0:15755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788802415.156570:0:15755:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788802415.156581:0:15755:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6ecba1490fc9cfe4 00000020:01000004:1.0:1788802415.156589:0:15755:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788802415.156612:0:15755:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.157@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788802415.156616:0:15755:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788802415.156622:0:15755:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788802415.156645:0:15755:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788802415.156649:0:15755:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788802415.168514:0:15755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788802415.168551:0:15755:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.157@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788802415.168556:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788802415.168557:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788802415.168562:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802415.168563:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802415.168564:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802415.168565:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802415.168566:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788802415.168568:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802415.168569:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788802415.168572:0:15755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788802415.168574:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788802415.168575:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788802415.168576:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802415.168577:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802415.168578:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802415.168579:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802415.168580:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788802415.168581:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802415.168582:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788802415.168609:0:15755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788802415.168629:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187008:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788802415.168855:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802415.169008:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3be47780 going to sleep for 11 seconds 00000100:00100000:0.0:1788802415.169451:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892187008 00000100:00100000:0.0:1788802415.169460:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892187008 00000100:00100000:1.0:1788802415.169649:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788802415.169660:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+16:15755:x1875694892187008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788802415.169691:0:14347:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788802415.169695:0:14347:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788802415.169698:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1788802415.180696:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802415.185612:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+16:15755:x1875694892187008:12345-0@lo:253:mount.lustre.0 Request processed in 15944us (16750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802415.185628:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788802415.185750:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187008:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788802415.185768:0:15755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788802415.185771:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788802415.185773:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788802415.185774:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788802415.185776:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788802415.185777:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788802415.185779:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788802415.185780:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788802415.185803:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788802415.185805:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788802415.185824:0:15755:0:(tgt_mount.c:101:server_register_mount()) register mount ffff910d0450b800 from lustre-OST0001 10000000:01000000:1.0:1788802415.185854:0:15755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788802415.185857:0:15755:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788802415.185865:0:15755:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff910d07c43380 local copy 00010000:00010000:1.0:1788802415.185876:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd91 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802415.186115:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788802415.186153:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802415.186180:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3be47540 going to sleep for 11 seconds 00000100:00100000:0.0:1788802415.187819:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892187136 00000100:00100000:0.0:1788802415.187834:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892187136 00000100:00100000:0.0:1788802415.187902:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788802415.187913:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+16:15755:x1875694892187136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788802415.188156:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+16:15755:x1875694892187136:12345-0@lo:501:mount.lustre.0 Request processed in 245us (2002us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788802415.188162:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788802415.188463:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187136:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788802415.188490:0:15755:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788802415.188621:0:15755:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788802415.188631:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd91 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.188643:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2000/0x6ecba1490fc9cd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cd91 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802415.188670:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff910d0450b800 10000000:01000000:2.0:1788802415.188675:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788802415.188682:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788802415.188685:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788802415.188689:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788802415.188692:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788802415.188735:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216ec00/0x6ecba1490fc9cfeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.188742:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d4216ec00/0x6ecba1490fc9cfeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.188749:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d4216ec00/0x6ecba1490fc9cfeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802415.188764:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788802415.188811:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802415.188882:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef26b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788802415.189387:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892187264 00000100:00100000:1.0:1788802415.189395:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892187264 00000100:00100000:1.0:1788802415.189442:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788802415.189451:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+16:15755:x1875694892187264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788802415.189463:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802415.189476:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3a0f3800/0x6ecba1490fc9cff2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9cfeb expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.189499:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f3800/0x6ecba1490fc9cff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9cfeb expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.189510:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3a0f3800/0x6ecba1490fc9cff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9cfeb expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.189518:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3800, rc 0) 00000100:00100000:1.0:1788802415.189565:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+17:15755:x1875694892187264:12345-0@lo:101:mount.lustre.0 Request processed in 115us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802415.189572:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788802415.189724:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788802415.189738:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d4216ec00/0x6ecba1490fc9cfeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cff2 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.189754:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d4216ec00/0x6ecba1490fc9cfeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9cff2 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788802415.190664:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788802415.191969:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788802415.192856:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788802415.192914:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788802415.192948:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788802415.192992:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788802415.193026:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788802415.193056:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788802415.193126:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788802415.193135:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788802415.193452:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802415.193526:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802415.193612:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef26900 going to sleep for 11 seconds 00000100:00100000:1.0:1788802415.193852:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892187392 00000100:00100000:1.0:1788802415.193861:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892187392 00000100:00100000:1.0:1788802415.193944:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788802415.193954:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3588a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+17:15755:x1875694892187392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788802415.194385:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3588a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+17:15755:x1875694892187392:12345-0@lo:501:mount.lustre.0 Request processed in 431us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802415.194393:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788802415.194489:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788802415.194527:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788802415.194569:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802415.199067:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d06335cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802415.199486:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892187520 00000100:00100000:2.0:1788802415.199499:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892187520 00000100:00100000:2.0:1788802415.199556:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788802415.199566:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d35889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+17:15755:x1875694892187520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788802415.200005:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d35889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+17:15755:x1875694892187520:12345-0@lo:503:mount.lustre.0 Request processed in 440us (5434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802415.200013:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788802415.201344:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788802415.202456:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788802415.202547:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788802415.202619:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802415.202663:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d06335cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802415.202893:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892187648 00000100:00100000:2.0:1788802415.202900:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892187648 00000100:00100000:2.0:1788802415.202938:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788802415.202947:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d35888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+17:15755:x1875694892187648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788802415.203160:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d35888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+17:15755:x1875694892187648:12345-0@lo:502:mount.lustre.0 Request processed in 214us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802415.203167:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788802415.203690:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788802415.203962:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788802415.204017:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788802415.204052:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788802415.204101:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788802415.204137:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788802415.204173:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788802415.205989:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788802415.206035:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788802415.206073:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788802415.206119:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788802415.206338:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802415.206413:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d06335cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802415.207149:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892187776 00000100:00100000:0.0:1788802415.207158:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892187776 00000100:00100000:2.0:1788802415.207462:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788802415.207475:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d35888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+17:15755:x1875694892187776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788802415.207700:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d35888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+17:15755:x1875694892187776:12345-0@lo:502:mount.lustre.0 Request processed in 227us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802415.207715:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788802415.207876:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788802415.207982:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788802415.207997:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788802415.209449:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788802415.209597:0:15756:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788802415.209605:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802415.209607:0:15756:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788802415.209613:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788802415.209628:0:15756:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff910d3436b380) 00000020:00000080:3.0:1788802415.209652:0:15756:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788802415.209657:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788802415.209795:0:15756:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d0450b800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788802415.209803:0:15756:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788802415.209813:0:15756:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6ecba1490fc9d000 00010000:00010000:3.0:1788802415.224051:0:15756:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788802415.224658:0:15756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788802415.226856:0:15756:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788802415.228880:0:15756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788802415.228894:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802415.228901:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802415.228903:0:15756:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788802415.228908:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802415.228911:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802415.228913:0:15756:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788802415.228915:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788802415.228917:0:15756:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788802415.228919:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802415.228921:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802415.228922:0:15756:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788802415.228939:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788802415.228942:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802415.228944:0:15756:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788802415.228947:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788802415.229003:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788802415.229007:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788802415.229008:0:15756:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788802415.229012:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788802415.229264:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788802415.229290:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788802415.229315:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216ec00/0x6ecba1490fc9cfeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cff2 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802415.229328:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d4216ec00/0x6ecba1490fc9cfeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9cff2 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802415.229336:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d0450b800 from 1 10000000:01000000:0.0:1788802415.229338:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788802415.229376:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802415.229384:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802415.229394:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802415.229418:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788802415.229490:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802415.229525:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fb900 going to sleep for 11 seconds 00000100:00100000:2.0:1788802415.229700:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892187904 00000100:00100000:2.0:1788802415.230271:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892187904 00000100:00100000:2.0:1788802415.230347:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788802415.230357:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3588a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+17:15755:x1875694892187904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788802415.230372:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802415.230388:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d4216fc00/0x6ecba1490fc9d00e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9d007 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.230415:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d4216fc00/0x6ecba1490fc9d00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9d007 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.230428:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d4216fc00/0x6ecba1490fc9d00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9d007 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.230436:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d4216fc00, rc 0) 00000100:00100000:2.0:1788802415.230500:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3588a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892187904:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802415.230508:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788802415.230565:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892187904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788802415.230582:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.230593:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788802415.231837:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788802415.232276:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788802415.232470:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788802415.232510:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788802415.232548:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788802415.232553:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788802415.232623:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802415.232681:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802415.232715:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef263c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802415.235037:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892188032 00000100:00100000:1.0:1788802415.235047:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892188032 00000100:00100000:1.0:1788802415.235089:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788802415.235096:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3588bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892188032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788802415.235376:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3588bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892188032:12345-0@lo:501:mount.lustre.0 Request processed in 280us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802415.235382:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788802415.235622:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802415.235667:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788802415.236013:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802415.236054:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef263c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802415.236315:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892188160 00000100:00100000:0.0:1788802415.236319:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892188160 00000100:00100000:0.0:1788802415.236342:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788802415.236347:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3588a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892188160:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788802415.236533:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3588a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892188160:12345-0@lo:503:mount.lustre.0 Request processed in 185us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802415.236538:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788802415.239140:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788802415.239763:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788802415.239885:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788802415.239958:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802415.240004:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d063359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802415.240091:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892188288 00000100:00100000:0.0:1788802415.240098:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892188288 00000100:00100000:0.0:1788802415.240151:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788802415.240161:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d35889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892188288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788802415.240404:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d35889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892188288:12345-0@lo:502:mount.lustre.0 Request processed in 243us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802415.240412:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788802415.240597:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788802415.240829:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788802415.240878:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788802415.240930:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788802415.240967:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788802415.240997:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788802415.241042:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788802415.241076:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788802415.241116:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788802415.242537:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788802415.242608:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802415.242709:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d063359c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788802415.246725:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892188416 00000100:00100000:1.0:1788802415.246740:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892188416 00000100:00100000:1.0:1788802415.246811:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788802415.246821:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d35889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892188416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788802415.247084:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d35889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892188416:12345-0@lo:502:mount.lustre.0 Request processed in 263us (4474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802415.247092:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788802415.247343:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788802415.247505:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788802415.247522:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788802415.253862:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788802415.253875:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802415.253877:0:15760:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788802415.253886:0:15760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d0450b800 00000020:00000080:3.0:1788802415.253888:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788802415.253896:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802415.253899:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802415.253901:0:15760:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788802415.253903:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788802415.253905:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802415.253907:0:15760:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788802415.253910:0:15760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff910d0450b800 00000020:00000080:3.0:1788802415.253912:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788802415.253973:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802415.253977:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802415.253979:0:15760:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788802415.253982:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788802415.253984:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802415.253985:0:15760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788802415.253988:0:15760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff910d0450b800 00000020:00000080:3.0:1788802415.253990:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788802415.254027:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788802415.254030:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788802415.254031:0:15760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788802415.254035:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788802415.257025:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788802415.257065:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788802415.257090:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.257101:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802415.257145:0:15755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788802415.257146:0:15755:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff910d0450b800 10000000:01000000:2.0:1788802415.257149:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff910d0450b800 10000000:01000000:2.0:1788802415.257151:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788802415.257155:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff910d0450b800 from 1 10000000:01000000:2.0:1788802415.257157:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788802415.257192:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216f200/0x6ecba1490fc9d015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.257201:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d4216f200/0x6ecba1490fc9d015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.257212:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d4216f200/0x6ecba1490fc9d015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802415.257264:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788802415.257322:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802415.257352:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef26d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788802415.263957:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892188544 00000100:00100000:1.0:1788802415.263973:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892188544 00000100:00100000:1.0:1788802415.264022:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788802415.264029:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892188544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788802415.264046:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802415.264062:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9d01c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9d015 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.264090:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9d01c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9d015 expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.264099:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3a0f3600/0x6ecba1490fc9d01c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9d015 expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.264105:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3600, rc 0) 00000100:00100000:1.0:1788802415.264175:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:15755:x1875694892188544:12345-0@lo:101:mount.lustre.0 Request processed in 147us (6852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802415.264180:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788802415.267403:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788802415.267429:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d4216f200/0x6ecba1490fc9d015 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d01c expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802415.267446:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d4216f200/0x6ecba1490fc9d015 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9d01c expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788802415.267997:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788802415.268369:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788802415.268526:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788802415.268552:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788802415.268569:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788802415.268606:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788802415.268666:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788802415.268715:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788802415.268751:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788802415.268803:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788802415.268869:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788802415.268909:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788802415.268942:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788802415.268973:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788802415.268994:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788802415.269011:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788802415.269035:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788802415.269052:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788802415.269068:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788802415.269091:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788802415.269108:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788802415.269124:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788802415.269165:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788802415.269985:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788802415.270049:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788802415.270113:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788802415.270153:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788802415.270189:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788802415.273334:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788802415.273436:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788802415.273471:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788802415.273521:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788802415.273559:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788802415.273594:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788802415.273630:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788802415.273678:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788802415.283565:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788802415.283692:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788802415.283762:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788802415.283892:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788802415.283901:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788802415.284019:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788802415.284090:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802415.284131:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1ab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802415.285481:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892188672 00000100:00100000:2.0:1788802415.285494:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892188672 00000100:00100000:2.0:1788802415.285550:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788802415.285561:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:15755:x1875694892188672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802415.285853:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:15755:x1875694892188672:12345-0@lo:501:mount.lustre.0 Request processed in 294us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802415.285861:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788802415.285945:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788802415.285994:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788802415.286041:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802415.286074:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef26000 going to sleep for 11 seconds 00000100:00100000:3.0:1788802415.286701:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892188800 00000100:00100000:3.0:1788802415.286708:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892188800 00000100:00100000:3.0:1788802415.286750:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788802415.286759:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:15755:x1875694892188800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788802415.287059:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:15755:x1875694892188800:12345-0@lo:503:mount.lustre.0 Request processed in 301us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802415.287067:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788802415.293008:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788802415.293683:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788802415.293770:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788802415.293871:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802415.293917:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef26000 going to sleep for 11 seconds 00000100:00100000:3.0:1788802415.296350:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892188928 00000100:00100000:3.0:1788802415.296368:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892188928 00000100:00100000:3.0:1788802415.296443:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788802415.296456:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:15755:x1875694892188928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788802415.296919:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:15755:x1875694892188928:12345-0@lo:502:mount.lustre.0 Request processed in 464us (3047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802415.296939:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788802415.297134:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892188928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788802415.297454:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788802415.297512:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788802415.297549:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788802415.297614:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788802415.297663:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788802415.297713:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788802415.297751:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788802415.297799:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788802415.297852:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788802415.297892:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788802415.297944:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788802415.297995:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788802415.298032:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788802415.298064:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788802415.298112:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788802415.298149:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788802415.298185:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788802415.298235:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788802415.298303:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788802415.298339:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788802415.298390:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788802415.298427:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788802415.298464:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788802415.298514:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788802415.298549:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788802415.298581:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788802415.298648:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788802415.298684:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788802415.298718:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788802415.298767:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788802415.304611:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788802415.304670:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788802415.304704:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788802415.304793:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788802415.304830:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788802415.304877:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788802415.304915:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788802415.304967:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788802415.305021:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788802415.305058:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788802415.305116:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892189056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788802415.305208:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802415.305360:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef26000 going to sleep for 11 seconds 00000100:00100000:0.0:1788802415.306777:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892189056 00000100:00100000:0.0:1788802415.306798:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892189056 00000100:00100000:0.0:1788802415.306862:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788802415.306873:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:15755:x1875694892189056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788802415.307164:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f985c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:15755:x1875694892189056:12345-0@lo:502:mount.lustre.0 Request processed in 292us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802415.307173:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788802415.307505:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892189056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788802415.307609:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788802415.307623:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788802415.308652:0:15765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788802415.308670:0:15765:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff910d07c40000) 00000020:00000080:2.0:1788802415.308691:0:15765:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788802415.308757:0:15765:0:(tgt_mount.c:153:server_get_mount()) get mount ffff910d0450b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788802415.308762:0:15765:0:(tgt_mount.c:187:server_put_mount()) put mount ffff910d0450b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788802415.308765:0:15765:0:(obd_mount.c:710:lustre_put_lsi()) put ffff910d0450b800 3 00010000:00080000:2.0:1788802415.308814:0:15765:0:(ldlm_lib.c:102:import_set_conn()) imp ffff910d08189000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788802415.310306:0:15765:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788802415.310462:0:15765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788802415.310486:0:15765:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788802415.310495:0:15765:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6ecba1490fc9d02a 00000100:00080000:2.0:1788802415.310503:0:15765:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788802415.310512:0:15765:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff910d08189000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788802415.310543:0:15765:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d3fad4e00 x1875694892189184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788802415.310578:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875694892189184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788802415.310649:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788802415.310706:0:15765:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788802415.310874:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892189184 00000100:00100000:3.0:1788802415.310883:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892189184 00000100:00100000:3.0:1788802415.310924:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788802415.310932:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875694892189184:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788802415.310958:0:14353:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:3.0:1788802415.311183:0:14353:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6ecba1490fc9d031 00000004:00100000:3.0:1788802415.311200:0:14353:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788802415.311234:0:14353:0:(import.c:65:import_set_state_nolock()) ffff910c02b6e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802415.311306:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875694892189184:12345-0@lo:38:llog_process_th.0 Request processed in 374us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802415.311311:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788802415.311360:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d3fad4e00 x1875694892189184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788802425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802415.311368:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788802415.311373:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788802415.311378:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788802415.311381:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788802415.311383:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d08189000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788802415.311386:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875694892189184:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788802415.311517:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788802415.311521:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788802415.311523:0:8:0:(import.c:65:import_set_state_nolock()) ffff910d3382b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788802415.311526:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 463 00000100:00080000:0.0:1788802415.311529:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788802415.311533:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910d3382b800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788802415.311545:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d10d3e300 x1875694892189440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788802415.311576:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892189696:0@lo:400:kworker.0 00000100:00100000:0.0:1788802415.311609:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802415.311644:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892189696 00000100:00100000:0.0:1788802415.311648:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892189696 00000100:00100000:0.0:1788802415.311683:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788802415.311688:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892189696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802415.311721:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875694892189696:12345-0@lo:400:kworker.0 Request processed in 32us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802415.311726:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788802415.311742:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788802415.311758:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3f800 x1875694892189696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802415.311768:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875694892189696:0@lo:400:kworker.0 00000100:00100000:3.0:1788802415.313349:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892189312:0@lo:400:kworker.0 00000100:00100000:3.0:1788802415.313398:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802415.313430:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788802415.313435:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892189568:0@lo:400:kworker.0 00000100:00100000:3.0:1788802415.313460:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802415.313488:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892189568 00000100:00100000:3.0:1788802415.313493:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892189568 00000100:00100000:3.0:1788802415.313517:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788802415.313522:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892189568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802415.313553:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875694892189568:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802415.313558:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788802415.313581:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff910d10d3c700 x1875694892189568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788802415.313592:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875694892189568:0@lo:400:kworker.0 00000100:00100000:3.0:1788802415.313614:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892189440:0@lo:8:kworker.0 00000100:00100000:3.0:1788802415.313642:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802415.313676:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892189312 00000100:00100000:3.0:1788802415.313680:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892189312 00000100:00100000:3.0:1788802415.313711:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892189440 00000100:00100000:3.0:1788802415.313714:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892189440 00000100:00100000:3.0:1788802415.313725:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788802415.313731:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892189312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802415.313766:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892189312:12345-0@lo:400:kworker.0 Request processed in 36us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802415.313772:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788802415.313796:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788802415.313800:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875694892189440:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788802415.313845:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875694892189440:12345-0@lo:8:kworker.0 Request processed in 43us (201us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788802415.313860:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788802415.313879:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802415.313895:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788802415.313906:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892189312:0@lo:400:kworker.0 00000100:00100000:3.0:1788802415.313928:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788802415.313934:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3382b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788802415.313938:0:3310:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788802415.313941:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892189440:0@lo:8:kworker.0 00000040:00080000:2.0:1788802415.319071:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788802415.319518:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788802415.319544:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788802415.319559:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216f200/0x6ecba1490fc9d015 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d01c expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802415.319569:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d4216f200/0x6ecba1490fc9d015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d01c expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788802415.319614:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788802415.319615:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788802415.319616:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788802415.319617:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788802415.319618:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788802415.319619:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788802415.319620:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788802415.319621:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788802415.319622:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788802415.319625:0:15755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788802415.319626:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788802415.319627:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788802415.319628:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788802415.319628:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788802415.319632:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788802415.319632:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788802415.319633:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788802415.319634:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788802415.319634:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788802415.319658:0:15755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788802415.319675:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892189824:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788802415.319740:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802415.319793:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff910c02100240 going to sleep for 11 seconds 00000100:00100000:0.0:1788802415.322346:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892189824 00000100:00100000:0.0:1788802415.322363:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892189824 00000100:00100000:0.0:1788802415.322430:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788802415.322441:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d03933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+19:15755:x1875694892189824:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788802415.322492:0:14348:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788802415.322507:0:14348:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788802415.341736:0:14348:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788802415.341755:0:14348:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788802415.341926:0:14369:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788802415.341932:0:14369:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788802415.341956:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.341975:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9cf0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9cf04 expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.341984:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.342026:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9cf0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9cf04 expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.342041:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9cf0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9cf04 expref: 19 pid: 14347 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802415.342055:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14369:1875694892189952:0@lo:104: 00000100:00100000:1.0:1788802415.342119:0:14369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802415.342181:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3be47540 going to sleep for 11 seconds 00000100:00100000:2.0:1788802415.342306:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892189952 00000100:00100000:2.0:1788802415.342314:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892189952 00000100:00100000:2.0:1788802415.342366:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788802415.342376:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+3:14369:x1875694892189952:12345-0@lo:104: 00010000:00010000:2.0:1788802415.342390:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342445:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788802415.342451:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+3:14369:x1875694892189952:12345-0@lo:104: Request processed in 77us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802415.342458:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788802415.342479:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802415.342485:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342492:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1000 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:2.0:1788802415.342496:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342505:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788802415.342511:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788802415.342517:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788802415.342545:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342551:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788802415.342579:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342587:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d206f1000/0x6ecba1490fc9cf04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9cf0b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342603:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802415.342605:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802415.342606:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802415.342625:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87cc913b-814f-413d-b622-408baef57c45:3312:1875694892190080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802415.342656:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802415.342703:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892190080 00000100:00100000:2.0:1788802415.342708:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892190080 00010000:00010000:2.0:1788802415.342725:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9cf0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9cf04 expref: 20 pid: 14347 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802415.342758:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788802415.342765:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87cc913b-814f-413d-b622-408baef57c45+20:3312:x1875694892190080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788802415.342777:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802415.342791:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9cf0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9cf04 expref: 20 pid: 14347 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342803:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9cf0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9cf04 expref: 20 pid: 14347 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342819:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342828:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788802415.342852:0:14340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001589933s 00010000:00010000:2.0:1788802415.342857:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342864:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342871:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342878:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342884:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802415.342889:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342897:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342906:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802415.342917:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802415.342955:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87cc913b-814f-413d-b622-408baef57c45+20:3312:x1875694892190080:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802415.342962:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788802415.343029:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87cc913b-814f-413d-b622-408baef57c45:3312:1875694892190080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788802415.343029:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216e000/0x6ecba1490fc9cf0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9cf04 expref: 19 pid: 14347 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802415.343040:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14369:1875694892189952:0@lo:104: 00010000:00010000:1.0:1788802415.343052:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.343061:0:14369:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.343068:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802415.343074:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d038 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802415.355948:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d03933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+18:15755:x1875694892189824:12345-0@lo:253:mount.lustre.0 Request processed in 33498us (36196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802415.355963:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788802415.356104:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:87cc913b-814f-413d-b622-408baef57c45:15755:1875694892189824:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788802415.356121:0:15755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788802415.356125:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788802415.356126:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788802415.356128:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788802415.356130:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788802415.356131:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788802415.356133:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788802415.356134:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788802415.356136:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788802415.356138:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788802415.356152:0:15755:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788802415.363904:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802415.364129:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788802415.364369:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788802415.364527:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788802415.365138:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788802415.365431:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788802415.366514:0:15755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788802415.449850:0:15755:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788802415.449861:0:15755:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788802415.449898:0:15755:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788802415.449953:0:15755:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788802415.449966:0:15755:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788802415.449986:0:15755:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1788802415.500541:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892190208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788802415.500615:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802415.500730:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892190208 00000100:00100000:0.0:1788802415.500738:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892190208 00000100:00100000:0.0:1788802415.500825:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788802415.500835:0:15041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892190208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802415.500884:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802415.500949:0:15041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892190208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802415.500956:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788802415.501035:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892190208:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788802416.204405:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788802416.604918:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788802416.973169:0:14350:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788802416.973177:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff910d3f90d800 from 8 10000000:01000000:2.0:1788802416.973182:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788802416.973227:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9d03f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802416.973268:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9d03f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802416.973280:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9d03f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802416.973305:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892190336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788802416.973372:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802416.973418:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef26240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802416.973647:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892190336 00000100:00100000:3.0:1788802416.973655:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892190336 00000100:00100000:3.0:1788802416.973710:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788802416.973719:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d03932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+18:14350:x1875694892190336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802416.973733:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802416.973747:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9d046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9d03f expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802416.973781:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9d046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9d03f expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802416.973792:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee8800/0x6ecba1490fc9d046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9d03f expref: 19 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802416.973802:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee8800, rc 0) 00000100:00100000:3.0:1788802416.973870:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d03932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:14350:x1875694892190336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802416.973876:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788802416.974218:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892190336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788802416.974235:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9d03f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d046 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802416.974260:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9d03f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9d046 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802416.974305:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892190464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788802416.974331:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802416.974357:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef26240 going to sleep for 11 seconds 00000100:00100000:3.0:1788802416.974400:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892190464 00000100:00100000:3.0:1788802416.974403:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892190464 00000100:00100000:3.0:1788802416.974427:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788802416.974432:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d03932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+19:14350:x1875694892190464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788802416.974442:0:14348:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788802416.974454:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788802416.974456:0:14348:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788802416.974510:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d03932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+19:14350:x1875694892190464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802416.974514:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788802416.974535:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892190464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788802416.974573:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788802416.974578:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9d03f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d046 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802416.974584:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d4216ea00/0x6ecba1490fc9d03f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d046 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802417.229485:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802418.257128:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802419.276538:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.300426:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788802420.625156:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788802420.625162:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788802420.625165:0:38:0:(import.c:65:import_set_state_nolock()) ffff910d3382b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788802420.625182:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff910d3382b800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788802420.625203:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff910d10d3f800 x1875694892190848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788802420.625463:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892190592:0@lo:400:kworker.0 00000100:00100000:0.0:1788802420.625530:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802420.625574:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892191232:0@lo:400:kworker.0 00000100:00100000:0.0:1788802420.625604:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802420.625760:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892190720:0@lo:400:kworker.0 00000100:00100000:2.0:1788802420.625793:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802420.625832:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788802420.625839:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892190976:0@lo:400:kworker.0 00000100:00100000:2.0:1788802420.626052:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892190720 00000100:00100000:2.0:1788802420.626061:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892190720 00000100:00100000:2.0:1788802420.626114:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788802420.626124:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892190720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802420.626180:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892190720:12345-0@lo:400:kworker.0 Request processed in 58us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802420.626188:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788802420.626209:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788802420.632753:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892190592 00000100:00100000:1.0:1788802420.632768:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892190592 00000100:00100000:1.0:1788802420.632825:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788802420.632834:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d03930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:3314:x1875694892190592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802420.632929:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d03930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:3314:x1875694892190592:12345-0@lo:400:kworker.0 Request processed in 96us (7398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802420.632937:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788802420.632981:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892190848:0@lo:8:kworker.0 00000100:00100000:1.0:1788802420.633014:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802420.633056:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892191104:0@lo:400:kworker.0 00000100:00100000:0.0:1788802420.635022:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892190592:0@lo:400:kworker.0 00000100:00100000:0.0:1788802420.635062:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892191232 00000100:00100000:0.0:1788802420.635069:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892191232 00000100:00100000:0.0:1788802420.635127:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788802420.635148:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892191232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802420.635214:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892191232:12345-0@lo:400:kworker.0 Request processed in 67us (9608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802420.635221:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788802420.635383:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892190848 00000100:00100000:0.0:1788802420.635387:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892190848 00000100:00100000:0.0:1788802420.635408:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788802420.635413:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875694892190848:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788802420.635441:0:15037:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:0.0:1788802420.635475:0:15037:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6ecba1490fc9d04d 00002000:00100000:0.0:1788802420.635490:0:15037:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff910d41986800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788802420.635495:0:15037:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788802420.635499:0:15037:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788802420.638115:0:15037:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788802420.638163:0:15037:0:(import.c:65:import_set_state_nolock()) ffff910d41981800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788802420.638289:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875694892190848:12345-0@lo:8:kworker.0 Request processed in 2870us (5270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802420.638300:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788802420.638402:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802420.638457:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892191104 00000100:00100000:0.0:1788802420.638467:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892191104 00000100:00100000:0.0:1788802420.638509:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788802420.638518:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892191104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802420.638562:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892191104:12345-0@lo:400:kworker.0 Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802420.638569:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788802420.638611:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3e680 x1875694892191232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802420.638638:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892191232:0@lo:400:kworker.0 00000100:00100000:0.0:1788802420.638717:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788802420.638730:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892191360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802420.638766:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788802420.638808:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3f480 x1875694892191104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802420.638818:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892191104:0@lo:400:kworker.0 00000100:00100000:0.0:1788802420.638872:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892191360 00000100:00100000:0.0:1788802420.638876:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892191360 00000100:00100000:0.0:1788802420.638901:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788802420.638908:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892191360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788802420.638934:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802420.639010:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892191360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802420.639016:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788802420.639089:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892191360:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788802420.639288:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802420.639303:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802420.639338:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892190720:0@lo:400:kworker.0 00000100:00100000:0.0:1788802420.639357:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892190976 00000100:00100000:0.0:1788802420.639360:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892190976 00000100:00100000:0.0:1788802420.639384:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788802420.639390:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892190976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802420.639426:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892190976:12345-0@lo:400:kworker.0 Request processed in 36us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802420.639441:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788802420.639471:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3e300 x1875694892190976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802420.639481:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892190976:0@lo:400:kworker.0 00010000:00080000:2.0:1788802420.639954:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d10d3f800 x1875694892190848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788802445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788802420.639968:0:3310:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788802420.639977:0:3310:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788802420.639983:0:3310:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788802420.639986:0:3310:0:(import.c:65:import_set_state_nolock()) ffff910d3382b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788802420.640000:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788802420.640005:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d10d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875694892190848:0@lo:8:kworker.0 00000004:00080000:2.0:1788802420.640056:0:14378:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788802420.640077:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14378:1875694892191616:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788802420.640115:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802420.640133:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3ef26180 going to sleep for 11 seconds 00000004:00080000:2.0:1788802420.640148:0:14377:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788802420.640650:0:14377:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 473587410346ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788802420.640677:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892191488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788802420.640730:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802420.640799:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892191488 00000100:00100000:2.0:1788802420.640806:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892191488 00000100:00100000:2.0:1788802420.640849:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788802420.640858:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875694892191488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788802420.640885:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802420.640925:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875694892191488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802420.640932:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788802420.641146:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910d3fad7b80 x1875694892191488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788802436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802420.641162:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892191488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788802420.642221:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892191616 00000100:00100000:2.0:1788802420.642234:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892191616 00000100:00100000:2.0:1788802420.642301:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802420.642310:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14378:x1875694892191616:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788802420.647913:0:15039:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788802420.647925:0:15039:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788802420.647932:0:15039:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00080000:0.0:1788802420.650313:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788802420.699428:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.699445:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9d054 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.699466:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.699471:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.699478:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9d054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.699514:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9d054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.699526:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9d054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.699533:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9d054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.699554:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788802420.700110:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.700117:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006976c23/0x6ecba1490fc9d05b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.700128:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.700132:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.700136:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006976c23/0x6ecba1490fc9d05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.700147:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006976c23/0x6ecba1490fc9d05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.700156:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006976c23/0x6ecba1490fc9d05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.700174:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006976c23/0x6ecba1490fc9d05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.700190:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788802420.700614:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.700620:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a7abcf/0x6ecba1490fc9d062 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.700630:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.700633:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.700637:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a7abcf/0x6ecba1490fc9d062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.700648:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2a7abcf/0x6ecba1490fc9d062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.700656:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a7abcf/0x6ecba1490fc9d062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.700663:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a7abcf/0x6ecba1490fc9d062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.700672:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788802420.701086:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.701093:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e944899/0x6ecba1490fc9d069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.701108:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.701111:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.701115:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e944899/0x6ecba1490fc9d069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.701123:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e944899/0x6ecba1490fc9d069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.701130:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e944899/0x6ecba1490fc9d069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.701137:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e944899/0x6ecba1490fc9d069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.701144:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788802420.701574:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.701581:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19a8feb/0x6ecba1490fc9d070 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.701590:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.701593:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.701597:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19a8feb/0x6ecba1490fc9d070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.701607:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b19a8feb/0x6ecba1490fc9d070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.701626:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19a8feb/0x6ecba1490fc9d070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.701633:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b19a8feb/0x6ecba1490fc9d070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.701641:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788802420.702049:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.702055:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb51a44e/0x6ecba1490fc9d077 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.702063:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.702067:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.702071:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb51a44e/0x6ecba1490fc9d077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.702080:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb51a44e/0x6ecba1490fc9d077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.702088:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb51a44e/0x6ecba1490fc9d077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.702094:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb51a44e/0x6ecba1490fc9d077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.702113:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788802420.702530:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.702536:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd14aaf7/0x6ecba1490fc9d07e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.702545:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.702548:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.702551:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd14aaf7/0x6ecba1490fc9d07e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.702560:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd14aaf7/0x6ecba1490fc9d07e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.702568:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd14aaf7/0x6ecba1490fc9d07e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.702576:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd14aaf7/0x6ecba1490fc9d07e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.702584:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788802420.707395:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.707407:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a9bc04c/0x6ecba1490fc9d085 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.707424:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.707434:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.707442:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a9bc04c/0x6ecba1490fc9d085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.707459:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a9bc04c/0x6ecba1490fc9d085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.707470:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a9bc04c/0x6ecba1490fc9d085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.707478:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a9bc04c/0x6ecba1490fc9d085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.707490:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788802420.709261:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.709273:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007accfe11/0x6ecba1490fc9d08c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.709288:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.709292:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.709298:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007accfe11/0x6ecba1490fc9d08c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.709311:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007accfe11/0x6ecba1490fc9d08c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.709322:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007accfe11/0x6ecba1490fc9d08c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.709337:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007accfe11/0x6ecba1490fc9d08c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.709347:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:0.0:1788802420.709777:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788802420.709785:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9d054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709794:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.709798:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9d054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709807:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9d054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709830:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9d054 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709838:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048433ba2/0x6ecba1490fc9d054 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709863:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788802420.709867:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006976c23/0x6ecba1490fc9d05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709886:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216f000 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.709890:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006976c23/0x6ecba1490fc9d05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709898:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006976c23/0x6ecba1490fc9d05b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709909:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006976c23/0x6ecba1490fc9d05b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709917:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006976c23/0x6ecba1490fc9d05b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709931:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788802420.709934:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2a7abcf/0x6ecba1490fc9d062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709942:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216e000 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.709945:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a7abcf/0x6ecba1490fc9d062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709953:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a7abcf/0x6ecba1490fc9d062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709962:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2a7abcf/0x6ecba1490fc9d062 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709976:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2a7abcf/0x6ecba1490fc9d062 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.709991:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788802420.709995:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e944899/0x6ecba1490fc9d069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710003:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e800 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.710006:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e944899/0x6ecba1490fc9d069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710016:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e944899/0x6ecba1490fc9d069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710027:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e944899/0x6ecba1490fc9d069 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710035:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e944899/0x6ecba1490fc9d069 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710048:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788802420.710052:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b19a8feb/0x6ecba1490fc9d070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710059:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95fe00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.710067:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19a8feb/0x6ecba1490fc9d070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710075:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19a8feb/0x6ecba1490fc9d070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710087:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b19a8feb/0x6ecba1490fc9d070 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710094:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19a8feb/0x6ecba1490fc9d070 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710108:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788802420.710112:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb51a44e/0x6ecba1490fc9d077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710118:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95fa00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.710121:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb51a44e/0x6ecba1490fc9d077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710129:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb51a44e/0x6ecba1490fc9d077 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710138:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb51a44e/0x6ecba1490fc9d077 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710145:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb51a44e/0x6ecba1490fc9d077 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710165:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788802420.710169:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd14aaf7/0x6ecba1490fc9d07e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710175:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ee00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.710178:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd14aaf7/0x6ecba1490fc9d07e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710186:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd14aaf7/0x6ecba1490fc9d07e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710196:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd14aaf7/0x6ecba1490fc9d07e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710203:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd14aaf7/0x6ecba1490fc9d07e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710214:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788802420.710218:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a9bc04c/0x6ecba1490fc9d085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710224:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ea00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.710227:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a9bc04c/0x6ecba1490fc9d085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710519:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a9bc04c/0x6ecba1490fc9d085 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710531:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a9bc04c/0x6ecba1490fc9d085 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710538:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a9bc04c/0x6ecba1490fc9d085 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710550:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802420.710554:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007accfe11/0x6ecba1490fc9d08c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710560:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.710563:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007accfe11/0x6ecba1490fc9d08c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710571:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007accfe11/0x6ecba1490fc9d08c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710581:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007accfe11/0x6ecba1490fc9d08c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710588:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007accfe11/0x6ecba1490fc9d08c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.710736:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.710738:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.710740:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.710751:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788802420.713058:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.713072:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9d093 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.713090:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.713094:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.713101:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9d093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.713116:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9d093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.713126:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9d093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.713134:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9d093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.713154:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788802420.713650:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788802420.713868:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802420.713877:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9d093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.713887:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95fc00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.713892:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9d093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.713900:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9d093 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.713916:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9d093 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.713924:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0aa4c26/0x6ecba1490fc9d093 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.713944:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.713946:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.713947:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802420.717090:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adfd8058/0x6ecba1490fc9d09a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.717125:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.717131:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.717138:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adfd8058/0x6ecba1490fc9d09a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.717155:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adfd8058/0x6ecba1490fc9d09a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.717167:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adfd8058/0x6ecba1490fc9d09a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.717175:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adfd8058/0x6ecba1490fc9d09a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.717223:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788802420.718800:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802420.718811:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adfd8058/0x6ecba1490fc9d09a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.718833:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e000 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.718838:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adfd8058/0x6ecba1490fc9d09a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.718849:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adfd8058/0x6ecba1490fc9d09a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.718869:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adfd8058/0x6ecba1490fc9d09a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.718877:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adfd8058/0x6ecba1490fc9d09a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.718900:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.718901:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.718903:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788802420.719821:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.719832:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d379b849/0x6ecba1490fc9d0a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.719845:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.719850:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.719856:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d379b849/0x6ecba1490fc9d0a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.719870:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d379b849/0x6ecba1490fc9d0a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.719892:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d379b849/0x6ecba1490fc9d0a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.719900:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d379b849/0x6ecba1490fc9d0a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.719920:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788802420.720399:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.720405:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3cb19b9/0x6ecba1490fc9d0a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.720414:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.720417:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.720421:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3cb19b9/0x6ecba1490fc9d0a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.720431:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3cb19b9/0x6ecba1490fc9d0a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.720438:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3cb19b9/0x6ecba1490fc9d0a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.720445:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3cb19b9/0x6ecba1490fc9d0a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.720471:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788802420.720877:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.720883:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040650743/0x6ecba1490fc9d0af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.720893:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.720897:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.720901:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040650743/0x6ecba1490fc9d0af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.720911:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040650743/0x6ecba1490fc9d0af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.720920:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040650743/0x6ecba1490fc9d0af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.720929:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040650743/0x6ecba1490fc9d0af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.720938:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788802420.721336:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.721342:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000035f44/0x6ecba1490fc9d0b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.721351:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.721360:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.721365:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000035f44/0x6ecba1490fc9d0b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.721375:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000035f44/0x6ecba1490fc9d0b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.721384:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000035f44/0x6ecba1490fc9d0b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.721391:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000035f44/0x6ecba1490fc9d0b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.721399:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788802420.721822:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.721828:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9d0bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.721837:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.721840:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.721845:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9d0bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.721854:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9d0bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.721863:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9d0bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.721877:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9d0bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.721886:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788802420.722267:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.722274:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000791841b5/0x6ecba1490fc9d0c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.722284:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.722287:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.722292:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000791841b5/0x6ecba1490fc9d0c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.722302:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000791841b5/0x6ecba1490fc9d0c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.722311:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000791841b5/0x6ecba1490fc9d0c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.722319:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000791841b5/0x6ecba1490fc9d0c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.722328:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1788802420.726385:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788802420.726400:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d379b849/0x6ecba1490fc9d0a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726414:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f800 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.726419:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d379b849/0x6ecba1490fc9d0a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726431:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d379b849/0x6ecba1490fc9d0a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726460:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d379b849/0x6ecba1490fc9d0a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726469:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d379b849/0x6ecba1490fc9d0a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726492:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788802420.726496:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3cb19b9/0x6ecba1490fc9d0a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726504:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.726507:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3cb19b9/0x6ecba1490fc9d0a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726515:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3cb19b9/0x6ecba1490fc9d0a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726526:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3cb19b9/0x6ecba1490fc9d0a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726533:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3cb19b9/0x6ecba1490fc9d0a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726545:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788802420.726549:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040650743/0x6ecba1490fc9d0af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726561:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f400 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.726565:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040650743/0x6ecba1490fc9d0af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726574:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040650743/0x6ecba1490fc9d0af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726585:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040650743/0x6ecba1490fc9d0af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726593:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040650743/0x6ecba1490fc9d0af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726606:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788802420.726610:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000035f44/0x6ecba1490fc9d0b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726827:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.726832:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000035f44/0x6ecba1490fc9d0b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726842:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000035f44/0x6ecba1490fc9d0b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726853:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000035f44/0x6ecba1490fc9d0b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726866:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000035f44/0x6ecba1490fc9d0b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726881:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788802420.726885:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9d0bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726892:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95ec00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.726895:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9d0bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726903:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9d0bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726914:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9d0bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726921:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000864e9dec/0x6ecba1490fc9d0bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726932:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802420.726935:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000791841b5/0x6ecba1490fc9d0c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726941:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95e600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.726950:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000791841b5/0x6ecba1490fc9d0c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726959:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000791841b5/0x6ecba1490fc9d0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726970:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000791841b5/0x6ecba1490fc9d0c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726977:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000791841b5/0x6ecba1490fc9d0c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.726990:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.726992:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.726994:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.727200:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788802420.728221:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.728232:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9d0cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.728273:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.728279:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.728285:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9d0cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.728299:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9d0cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.728308:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9d0cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.728316:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9d0cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.728338:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788802420.728800:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802420.728808:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9d0cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.728816:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.728821:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9d0cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.728830:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9d0cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.728845:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9d0cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.728860:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f45f6e2e/0x6ecba1490fc9d0cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.728879:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.728882:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.728883:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788802420.731116:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.731128:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9d0d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.731145:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.731150:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.731156:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9d0d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.731170:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9d0d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.731191:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9d0d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.731199:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9d0d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.731223:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788802420.732019:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802420.732027:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9d0d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.732037:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3f95f000 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.732042:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9d0d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.732052:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9d0d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.732070:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9d0d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.732078:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac40b7cf/0x6ecba1490fc9d0d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.732098:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.732100:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.732102:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788802420.736792:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.736810:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec6fe9b1/0x6ecba1490fc9d0d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.736829:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.736834:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.736841:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6fe9b1/0x6ecba1490fc9d0d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.736856:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec6fe9b1/0x6ecba1490fc9d0d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.736867:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec6fe9b1/0x6ecba1490fc9d0d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.736875:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec6fe9b1/0x6ecba1490fc9d0d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.736913:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788802420.737502:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.737509:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ece8308/0x6ecba1490fc9d0e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.737520:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.737523:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.737528:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ece8308/0x6ecba1490fc9d0e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.737536:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ece8308/0x6ecba1490fc9d0e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.737544:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ece8308/0x6ecba1490fc9d0e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.737551:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ece8308/0x6ecba1490fc9d0e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.737574:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788802420.738008:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.738014:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c16a44/0x6ecba1490fc9d0e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.738024:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.738033:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.738038:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c16a44/0x6ecba1490fc9d0e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.738048:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c16a44/0x6ecba1490fc9d0e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.738057:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c16a44/0x6ecba1490fc9d0e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.738066:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088c16a44/0x6ecba1490fc9d0e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.738074:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788802420.738496:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.738503:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434f3971/0x6ecba1490fc9d0ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.738511:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.738514:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.738518:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000434f3971/0x6ecba1490fc9d0ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.738528:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000434f3971/0x6ecba1490fc9d0ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.738537:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434f3971/0x6ecba1490fc9d0ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.738551:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000434f3971/0x6ecba1490fc9d0ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.738560:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788802420.741069:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788802420.741083:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec6fe9b1/0x6ecba1490fc9d0d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741098:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219a600 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.741104:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec6fe9b1/0x6ecba1490fc9d0d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741117:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec6fe9b1/0x6ecba1490fc9d0d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741142:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec6fe9b1/0x6ecba1490fc9d0d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741151:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec6fe9b1/0x6ecba1490fc9d0d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741175:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788802420.741179:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ece8308/0x6ecba1490fc9d0e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741186:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219a800 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.741189:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ece8308/0x6ecba1490fc9d0e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741198:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ece8308/0x6ecba1490fc9d0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741224:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ece8308/0x6ecba1490fc9d0e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741232:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ece8308/0x6ecba1490fc9d0e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741263:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788802420.741267:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088c16a44/0x6ecba1490fc9d0e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741273:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219bc00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.741276:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c16a44/0x6ecba1490fc9d0e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741284:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c16a44/0x6ecba1490fc9d0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741294:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088c16a44/0x6ecba1490fc9d0e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741302:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c16a44/0x6ecba1490fc9d0e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741312:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802420.741316:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000434f3971/0x6ecba1490fc9d0ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741328:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219ae00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802420.741332:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000434f3971/0x6ecba1490fc9d0ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741340:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000434f3971/0x6ecba1490fc9d0ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741351:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000434f3971/0x6ecba1490fc9d0ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741359:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000434f3971/0x6ecba1490fc9d0ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802420.741370:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.741372:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802420.741373:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802420.741533:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788802420.747132:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.747147:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f35ece05/0x6ecba1490fc9d0f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.747165:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.747170:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.747177:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f35ece05/0x6ecba1490fc9d0f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.747192:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f35ece05/0x6ecba1490fc9d0f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.747203:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f35ece05/0x6ecba1490fc9d0f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.747211:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f35ece05/0x6ecba1490fc9d0f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.747233:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788802420.747280:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802420.747286:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f35ece05/0x6ecba1490fc9d0f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.747301:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219a000 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802420.747306:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f35ece05/0x6ecba1490fc9d0f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.747315:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f35ece05/0x6ecba1490fc9d0f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.747333:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f35ece05/0x6ecba1490fc9d0f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.747340:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f35ece05/0x6ecba1490fc9d0f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.747361:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802420.747363:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802420.747365:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788802420.749723:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.749738:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d9bc00/0x6ecba1490fc9d0fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.749755:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.749759:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.749766:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d9bc00/0x6ecba1490fc9d0fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.749781:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d9bc00/0x6ecba1490fc9d0fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.749799:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d9bc00/0x6ecba1490fc9d0fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.749807:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d9bc00/0x6ecba1490fc9d0fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.749834:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788802420.750308:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.750314:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff3812e/0x6ecba1490fc9d103 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750323:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.750326:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.750331:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aff3812e/0x6ecba1490fc9d103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750340:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aff3812e/0x6ecba1490fc9d103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750349:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff3812e/0x6ecba1490fc9d103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750357:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aff3812e/0x6ecba1490fc9d103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750379:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788802420.750392:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788802420.750398:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d9bc00/0x6ecba1490fc9d0fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750405:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219ba00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802420.750410:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d9bc00/0x6ecba1490fc9d0fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750420:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d9bc00/0x6ecba1490fc9d0fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750434:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d9bc00/0x6ecba1490fc9d0fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750441:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d9bc00/0x6ecba1490fc9d0fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750458:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802420.750462:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aff3812e/0x6ecba1490fc9d103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750468:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219aa00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802420.750471:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff3812e/0x6ecba1490fc9d103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750491:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff3812e/0x6ecba1490fc9d103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750501:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aff3812e/0x6ecba1490fc9d103 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750508:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aff3812e/0x6ecba1490fc9d103 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.750520:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802420.750521:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802420.750523:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788802420.750746:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788802420.751096:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788802420.751103:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd597120/0x6ecba1490fc9d10a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.751113:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=473s v=(0 0) 00010000:00010000:2.0:1788802420.751116:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802420.751121:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd597120/0x6ecba1490fc9d10a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.751130:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd597120/0x6ecba1490fc9d10a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.751139:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd597120/0x6ecba1490fc9d10a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.751156:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd597120/0x6ecba1490fc9d10a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.751170:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788802420.751178:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788802420.751182:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd597120/0x6ecba1490fc9d10a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.751189:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219ac00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802420.751193:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd597120/0x6ecba1490fc9d10a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.751201:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd597120/0x6ecba1490fc9d10a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.751211:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd597120/0x6ecba1490fc9d10a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.751218:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd597120/0x6ecba1490fc9d10a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802420.751231:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802420.751233:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802420.751234:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788802420.751404:0:15039:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1788802420.751489:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14378:x1875694892191616:12345-0@lo:5:osp-pre-1-0.0 Request processed in 109178us (111371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802420.751504:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802420.751552:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14378:1875694892191616:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788802420.751565:0:14378:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788802420.751853:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14378:1875694892191744:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788802420.751888:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802420.751970:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fb840 going to sleep for 11 seconds 00000100:00100000:2.0:1788802420.751984:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892191744 00000100:00100000:2.0:1788802420.751989:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892191744 00000004:00080000:3.0:1788802420.752440:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788802420.756320:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788802420.756347:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14378:x1875694892191744:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788802420.756410:0:15038:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788802420.766147:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14378:x1875694892191744:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9804us (14248us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788802420.766163:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788802420.766447:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3fad6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14378:1875694892191744:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788802420.766465:0:14378:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788802421.325458:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802422.348624:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788802422.888925:0:16112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788802423.377253:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802424.396427:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802425.123227:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802425.123350:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872272768 00000100:00100000:2.0:1788802425.123360:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872272768 00000100:00100000:2.0:1788802425.123411:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:2.0:1788802425.123420:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d03931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2356:x1875694872272768:12345-192.168.201.57@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788802425.123449:0:14346:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5b2e0225-aaaf-4b10-912e-97a2922a7720@192.168.201.57@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1788802425.123476:0:14346:0:(genops.c:1384:class_connect()) connect: client 5b2e0225-aaaf-4b10-912e-97a2922a7720, cookie 0x6ecba1490fc9d111 00000100:00080000:2.0:1788802425.123619:0:14346:0:(import.c:65:import_set_state_nolock()) ffff910d1126b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788802425.123688:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d03931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+5:2356:x1875694872272768:12345-192.168.201.57@tcp:250:mount.lustre.0 Request processed in 267us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802425.123695:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 73 00000100:00100000:3.0:1788802425.155383:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802425.155518:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872272896 00000100:00100000:1.0:1788802425.155530:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872272896 00000100:00100000:1.0:1788802425.155602:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:1.0:1788802425.155622:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+5:13755:x1875694872272896:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788802425.155639:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802425.155658:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3a0f2a00/0x6ecba1490fc9d118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edf029 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802425.155697:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f2a00/0x6ecba1490fc9d118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf029 expref: 6 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802425.155707:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3a0f2a00/0x6ecba1490fc9d118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf029 expref: 6 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802425.155716:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2a00, rc 0) 00000100:00100000:1.0:1788802425.155779:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+6:13755:x1875694872272896:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 168us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802425.155787:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 74 00000100:00100000:3.0:1788802425.163837:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802425.164050:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872273024 00000100:00100000:0.0:1788802425.164063:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872273024 00000100:00100000:0.0:1788802425.164133:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:0.0:1788802425.164143:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+6:13755:x1875694872273024:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788802425.164539:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+6:13755:x1875694872273024:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 396us (711us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788802425.164548:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 75 00000100:00100000:0.0:1788802425.169294:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802425.169414:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872273152 00000100:00100000:2.0:1788802425.169426:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872273152 00000100:00100000:3.0:1788802425.169679:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00100000:3.0:1788802425.169691:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+6:13755:x1875694872273152:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788802425.169708:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802425.169727:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee9c00/0x6ecba1490fc9d11f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edf030 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802425.169756:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee9c00/0x6ecba1490fc9d11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf030 expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802425.169769:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee9c00/0x6ecba1490fc9d11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf030 expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802425.169779:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9c00, rc 0) 00000100:00100000:3.0:1788802425.169838:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+7:13755:x1875694872273152:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 148us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802425.169845:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 76 00000100:00100000:0.0:1788802425.175417:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802425.175523:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872273280 00000100:00100000:1.0:1788802425.175545:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872273280 00000100:00100000:1.0:1788802425.175605:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 77 00000100:00100000:1.0:1788802425.175625:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+7:13755:x1875694872273280:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788802425.175918:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+8:13755:x1875694872273280:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 294us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802425.175925:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 77 00000100:00100000:1.0:1788802425.187601:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802425.188957:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872273408 00000100:00100000:0.0:1788802425.188971:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872273408 00000100:00100000:0.0:1788802425.189043:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:0.0:1788802425.189052:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+8:13755:x1875694872273408:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788802425.189393:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+8:13755:x1875694872273408:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 341us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802425.189402:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:0.0:1788802425.196132:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802425.196438:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872273536 00000100:00100000:3.0:1788802425.196449:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872273536 00000100:00100000:3.0:1788802425.196509:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788802425.196519:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+8:13773:x1875694872273536:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788802425.196895:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+8:13773:x1875694872273536:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 376us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802425.196904:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788802425.213644:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802425.213884:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872273664 00000100:00100000:1.0:1788802425.213894:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872273664 00000100:00100000:1.0:1788802425.213953:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:1.0:1788802425.213964:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+8:13773:x1875694872273664:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788802425.215297:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+8:13773:x1875694872273664:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 1327us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802425.215310:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 80 00000100:00100000:1.0:1788802425.229334:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802425.229382:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872273792 00000100:00100000:1.0:1788802425.229393:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872273792 00000100:00100000:1.0:1788802425.229459:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:1.0:1788802425.229469:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+8:13755:x1875694872273792:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788802425.229486:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802425.229503:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3a0f2c00/0x6ecba1490fc9d126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edf05a expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802425.229531:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f2c00/0x6ecba1490fc9d126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf05a expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802425.229543:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3a0f2c00/0x6ecba1490fc9d126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf05a expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802425.229565:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2c00, rc 0) 00000100:00100000:1.0:1788802425.229640:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+9:13755:x1875694872273792:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 172us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802425.229647:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:0.0:1788802425.245903:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802425.246575:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872273920 00000100:00100000:1.0:1788802425.246589:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872273920 00000100:00100000:1.0:1788802425.246658:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:1.0:1788802425.246669:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+9:13755:x1875694872273920:12345-192.168.201.57@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788802425.246694:0:14348:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788802425.246718:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788802425.246721:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788802425.246725:0:14348:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788802425.246727:0:14348:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788802425.249367:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+9:13755:x1875694872273920:12345-192.168.201.57@tcp:256:mount.lustre.0 Request processed in 2686us (3461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802425.249385:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:3.0:1788802425.254459:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802425.254570:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872274048 00000100:00100000:0.0:1788802425.254580:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872274048 00000100:00100000:0.0:1788802425.254646:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:0.0:1788802425.254656:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+9:13755:x1875694872274048:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788802425.254672:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802425.254689:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d12d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edf061 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802425.254718:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d12d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf061 expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802425.254741:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d12d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf061 expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802425.254750:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1000, rc 0) 00000100:00100000:0.0:1788802425.254817:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+10:13755:x1875694872274048:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 162us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802425.254824:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:0.0:1788802425.263819:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802425.264210:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872274176 00000100:00100000:1.0:1788802425.264221:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872274176 00000100:00100000:1.0:1788802425.264371:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:1.0:1788802425.264381:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+10:13755:x1875694872274176:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788802425.264938:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+10:13755:x1875694872274176:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 555us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802425.264947:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:1.0:1788802425.271527:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802425.271732:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872274304 00000100:00100000:3.0:1788802425.271756:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872274304 00000100:00100000:3.0:1788802425.271816:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:3.0:1788802425.271826:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+10:13755:x1875694872274304:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788802425.272155:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+10:13755:x1875694872274304:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 329us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802425.272164:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:3.0:1788802425.275988:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802425.276549:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872274432 00000100:00100000:1.0:1788802425.276572:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872274432 00000100:00100000:1.0:1788802425.276637:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:1.0:1788802425.276648:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f9df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+10:13778:x1875694872274432:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788802425.276939:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f9df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+10:13778:x1875694872274432:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 292us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802425.276947:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:1.0:1788802425.288024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802425.291328:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872274560 00000100:00100000:0.0:1788802425.291344:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872274560 00000100:00100000:0.0:1788802425.291400:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 87 00000100:00100000:0.0:1788802425.291408:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+10:13778:x1875694872274560:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788802425.291966:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+10:13778:x1875694872274560:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 556us (3949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802425.291975:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 87 00000100:00100000:0.0:1788802425.324391:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802425.324797:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872274688 00000100:00100000:2.0:1788802425.324808:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872274688 00000100:00100000:2.0:1788802425.324859:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788802425.324869:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1875694872274688:12345-192.168.201.57@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788802425.324915:0:14354:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 364c129c-855f-4ad1-8a13-12da787d546b@192.168.201.57@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1788802425.324963:0:14354:0:(genops.c:1384:class_connect()) connect: client 364c129c-855f-4ad1-8a13-12da787d546b, cookie 0x6ecba1490fc9d134 00000004:00100000:2.0:1788802425.324993:0:14354:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788802425.324999:0:14354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788802425.419833:0:14354:0:(import.c:65:import_set_state_nolock()) ffff910d1126e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788802425.419929:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+6:2356:x1875694872274688:12345-192.168.201.57@tcp:38:mount.lustre.0 Request processed in 95059us (95548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802425.419940:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00010000:00010000:2.0:1788802425.420890:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802425.427690:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802425.427735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802425.427894:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872274944 00000100:00100000:0.0:1788802425.427905:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872274944 00000100:00100000:0.0:1788802425.427979:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872274816 00000100:00100000:0.0:1788802425.427983:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872274816 00000100:00100000:0.0:1788802425.428002:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:0.0:1788802425.428011:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+7:13755:x1875694872274944:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788802425.428069:0:14355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788802425.428157:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+7:13755:x1875694872274944:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 147us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802425.428182:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:0.0:1788802425.428201:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:0.0:1788802425.428208:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+6:0:x1875694872274816:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788802425.428220:0:14355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788802425.428289:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+6:0:x1875694872274816:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 80us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802425.428295:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00080000:2.0:1788802425.428773:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802425.431781:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802425.431866:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872275072 00000100:00100000:0.0:1788802425.431876:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872275072 00000100:00100000:0.0:1788802425.431941:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:0.0:1788802425.431951:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+6:13755:x1875694872275072:12345-192.168.201.57@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788802425.432048:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+6:13755:x1875694872275072:12345-192.168.201.57@tcp:40:mount.lustre.0 Request processed in 97us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802425.432056:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:0.0:1788802425.437354:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802425.437404:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802425.437449:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802425.437595:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872275456 00000100:00100000:1.0:1788802425.437615:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872275456 00000100:00100000:1.0:1788802425.437670:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:1.0:1788802425.437680:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:364c129c-855f-4ad1-8a13-12da787d546b+6:13755:x1875694872275456:12345-192.168.201.57@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788802425.438293:0:14356:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 544us 00000100:00100000:3.0:1788802425.443766:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872275200 00000100:00100000:3.0:1788802425.443782:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872275200 00000100:00100000:3.0:1788802425.444384:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872275328 00000100:00100000:3.0:1788802425.444392:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872275328 00000100:00100000:3.0:1788802425.444416:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:3.0:1788802425.444426:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875694872275200:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788802425.444471:0:15037:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 364c129c-855f-4ad1-8a13-12da787d546b@192.168.201.57@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1788802425.444502:0:15037:0:(genops.c:1384:class_connect()) connect: client 364c129c-855f-4ad1-8a13-12da787d546b, cookie 0x6ecba1490fc9d13b 00002000:00100000:3.0:1788802425.444514:0:15037:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 364c129c-855f-4ad1-8a13-12da787d546b/ffff910c02b6a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788802425.444538:0:15037:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788802425.444877:0:15037:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788802425.444912:0:15037:0:(import.c:65:import_set_state_nolock()) ffff910c02b6f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802425.445003:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:364c129c-855f-4ad1-8a13-12da787d546b+6:2356:x1875694872275200:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 576us (7596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802425.445010:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:3.0:1788802425.445029:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788802425.445033:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875694872275328:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788802425.445061:0:15037:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 364c129c-855f-4ad1-8a13-12da787d546b@192.168.201.57@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1788802425.445077:0:15037:0:(genops.c:1384:class_connect()) connect: client 364c129c-855f-4ad1-8a13-12da787d546b, cookie 0x6ecba1490fc9d142 00002000:00100000:3.0:1788802425.445083:0:15037:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 364c129c-855f-4ad1-8a13-12da787d546b/ffff910c02b6c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788802425.445096:0:15037:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788802425.445212:0:15037:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788802425.445262:0:15037:0:(import.c:65:import_set_state_nolock()) ffff910c02b69800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802425.445289:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:364c129c-855f-4ad1-8a13-12da787d546b+6:2356:x1875694872275328:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 254us (7839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802425.445296:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000004:00200000:3.0:1788802425.470202:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788802425.470375:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:364c129c-855f-4ad1-8a13-12da787d546b+6:13755:x1875694872275456:12345-192.168.201.57@tcp:33:mount.lustre.0 Request processed in 32690us (33026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802425.470389:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788802425.741049:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892192256:0@lo:400:kworker.0 00000100:00100000:3.0:1788802425.741135:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802425.741202:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802425.741209:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892192128:0@lo:400:kworker.0 00000100:00100000:3.0:1788802425.741261:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802425.741301:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892192128 00000100:00100000:3.0:1788802425.741309:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892192128 00000100:00100000:3.0:1788802425.741368:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788802425.741378:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875694892192128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802425.741433:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875694892192128:12345-0@lo:400:kworker.0 Request processed in 56us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802425.741440:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788802425.741476:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788802425.741509:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892192128:0@lo:400:kworker.0 00000100:00100000:1.0:1788802425.742025:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892192256 00000100:00100000:1.0:1788802425.742031:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892192256 00000100:00100000:1.0:1788802425.742061:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788802425.742069:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892192256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802425.742112:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892192256:12345-0@lo:400:kworker.0 Request processed in 44us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802425.742119:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788802425.745720:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892192768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802425.745799:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788802425.745865:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910c02fa5f80 x1875694892192256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788802425.745865:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892192768 00000100:00100000:2.0:1788802425.745871:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892192768 00000100:00100000:3.0:1788802425.745879:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892192256:0@lo:400:kworker.0 00000100:00100000:3.0:1788802425.745897:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802425.745903:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892192640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802425.745913:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788802425.745921:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875694892192768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802425.745926:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788802425.745942:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802425.745983:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875694892192768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802425.745990:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788802425.746006:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892192640 00000100:00100000:2.0:1788802425.746009:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892192640 00000100:00100000:2.0:1788802425.746033:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788802425.746039:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892192640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788802425.746049:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802425.746075:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892192640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802425.746080:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788802425.746107:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802425.746132:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892192640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802425.746143:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892192768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802425.746453:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87cc913b-814f-413d-b622-408baef57c45:3313:1875694892191872:0@lo:400:kworker.0 00000100:00100000:0.0:1788802425.746493:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802425.746521:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892192384:0@lo:400:kworker.0 00000100:00100000:0.0:1788802425.746548:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802425.746567:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788802425.746574:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892192000:0@lo:400:kworker.0 00000100:00100000:0.0:1788802425.746592:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802425.746634:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892192512:0@lo:400:kworker.0 00000100:00100000:0.0:1788802425.746657:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802425.746688:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892192384 00000100:00100000:0.0:1788802425.746693:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892192384 00000100:00100000:0.0:1788802425.746723:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892192512 00000100:00100000:0.0:1788802425.746726:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892192512 00000100:00100000:0.0:1788802425.746738:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788802425.746744:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892192384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802425.746781:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892192384:12345-0@lo:400:kworker.0 Request processed in 37us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802425.746787:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788802425.746799:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788802425.746804:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892192512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802425.746829:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892192512:12345-0@lo:400:kworker.0 Request processed in 25us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802425.746835:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788802425.746850:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892192000 00000100:00100000:0.0:1788802425.746854:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892192000 00000100:00100000:0.0:1788802425.746875:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788802425.746881:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892192000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802425.746909:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892192000:12345-0@lo:400:kworker.0 Request processed in 29us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802425.746914:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788802425.746951:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892192000:0@lo:400:kworker.0 00010000:00080000:0.0:1788802425.746961:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910c02fa4e00 x1875694892192512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802425.746981:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892192512:0@lo:400:kworker.0 00010000:00080000:0.0:1788802425.746992:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff910c02fa6680 x1875694892192384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788802441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788802425.747000:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892192384:0@lo:400:kworker.0 00000100:00100000:0.0:1788802425.747022:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892191872 00000100:00100000:0.0:1788802425.747025:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892191872 00000100:00100000:0.0:1788802425.747049:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788802425.747055:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:3313:x1875694892191872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788802425.747089:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:3313:x1875694892191872:12345-0@lo:400:kworker.0 Request processed in 34us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802425.747095:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788802425.747127:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:87cc913b-814f-413d-b622-408baef57c45:3313:1875694892191872:0@lo:400:kworker.0 00000100:00080000:3.0:1788802425.748137:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802425.756433:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802425.756498:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872275584 00000100:00100000:2.0:1788802425.756507:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872275584 00000100:00100000:2.0:1788802425.756561:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788802425.756572:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+6:13799:x1875694872275584:12345-192.168.201.57@tcp:101:mkdir.0 00010000:00010000:2.0:1788802425.756592:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802425.756628:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf08b expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802425.756701:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a400/0x6ecba1490fc9d150 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802425.756714:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a400/0x6ecba1490fc9d150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802425.756730:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a400/0x6ecba1490fc9d150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802425.756763:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788802425.756767:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802425.756800:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a400/0x6ecba1490fc9d150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802425.756824:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf08b expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802425.756860:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a400/0x6ecba1490fc9d150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf08b expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802425.756869:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6900) 00010000:00010000:2.0:1788802425.756872:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802425.756876:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219a400, rc 0) 00000100:00100000:2.0:1788802425.756929:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+7:13799:x1875694872275584:12345-192.168.201.57@tcp:101:mkdir.0 Request processed in 360us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802425.756936:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000001:00100000:0.0:1788802425.819132:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 364c129c-855f-4ad1-8a13-12da787d546b 00000001:00080000:3.0:1788802425.855979:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788802425.855998:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788802425.856362:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 364c129c-855f-4ad1-8a13-12da787d546b 00010000:00010000:0.0:1788802426.448192:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788802426.828978:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788802427.469084:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802428.192622:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802428.196521:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872275712 00000100:00100000:0.0:1788802428.196538:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872275712 00000100:00080000:3.0:1788802428.196652:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788802428.196660:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:0.0:1788802428.196676:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+7:13852:x1875694872275712:12345-192.168.201.57@tcp:41:lfs.0 00000004:00000024:0.0:1788802428.196721:0:14354:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788802428.196835:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+7:13852:x1875694872275712:12345-192.168.201.57@tcp:41:lfs.0 Request processed in 165us (4223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.196842:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:2.0:1788802428.206690:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802428.207136:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872275840 00000100:00100000:0.0:1788802428.207163:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872275840 00000100:00080000:3.0:1788802428.207297:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802428.207303:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:0.0:1788802428.207316:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:364c129c-855f-4ad1-8a13-12da787d546b+5:13852:x1875694872275840:12345-192.168.201.57@tcp:13:lfs.0 00002000:00000024:0.0:1788802428.207357:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802428.207450:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:364c129c-855f-4ad1-8a13-12da787d546b+5:13852:x1875694872275840:12345-192.168.201.57@tcp:13:lfs.0 Request processed in 137us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.207457:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788802428.216335:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802428.217339:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872275968 00000100:00100000:0.0:1788802428.217352:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872275968 00000100:00100000:0.0:1788802428.217439:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:0.0:1788802428.217458:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:364c129c-855f-4ad1-8a13-12da787d546b+5:13852:x1875694872275968:12345-192.168.201.57@tcp:13:lfs.0 00002000:00000024:0.0:1788802428.217503:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802428.217610:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:364c129c-855f-4ad1-8a13-12da787d546b+5:13852:x1875694872275968:12345-192.168.201.57@tcp:13:lfs.0 Request processed in 154us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.217617:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00080000:3.0:1788802428.217769:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788802428.492430:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802428.577745:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802428.577973:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872276096 00000100:00100000:0.0:1788802428.577986:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872276096 00000100:00100000:0.0:1788802428.578053:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:0.0:1788802428.578064:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+10:13886:x1875694872276096:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788802428.578082:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802428.578104:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f1a00/0x6ecba1490fc9d157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edf092 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802428.578133:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f1a00/0x6ecba1490fc9d157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf092 expref: 11 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802428.578162:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f1a00/0x6ecba1490fc9d157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf092 expref: 11 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802428.578183:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1a00, rc 0) 00000100:00100000:0.0:1788802428.578275:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13886:x1875694872276096:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 212us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.578283:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:2.0:1788802428.589033:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802428.590693:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872276224 00000100:00100000:0.0:1788802428.590707:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872276224 00000100:00100000:0.0:1788802428.590777:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:0.0:1788802428.590788:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13886:x1875694872276224:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788802428.591122:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13886:x1875694872276224:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 335us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.591130:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:2.0:1788802428.598089:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802428.598384:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872276352 00000100:00100000:3.0:1788802428.598395:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872276352 00000100:00100000:3.0:1788802428.598453:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 91 00000100:00100000:3.0:1788802428.598465:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13886:x1875694872276352:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788802428.598793:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13886:x1875694872276352:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 329us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802428.598803:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 91 00000100:00100000:1.0:1788802428.603413:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802428.603858:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872276480 00000100:00100000:0.0:1788802428.603869:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872276480 00000100:00100000:0.0:1788802428.603922:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:0.0:1788802428.603933:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13892:x1875694872276480:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788802428.604365:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13892:x1875694872276480:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 432us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.604373:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:2.0:1788802428.640962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802428.641270:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872276608 00000100:00100000:0.0:1788802428.641280:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872276608 00000100:00100000:0.0:1788802428.641339:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:0.0:1788802428.641351:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13892:x1875694872276608:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788802428.641981:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13892:x1875694872276608:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 630us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.641990:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:2.0:1788802428.652109:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802428.652303:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872276736 00000100:00100000:0.0:1788802428.652315:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872276736 00000100:00100000:0.0:1788802428.652367:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:0.0:1788802428.652378:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13886:x1875694872276736:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788802428.652395:0:14348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802428.652415:0:14348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f0800/0x6ecba1490fc9d15e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edf0bc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802428.652447:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f0800/0x6ecba1490fc9d15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0bc expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802428.652460:0:14348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f0800/0x6ecba1490fc9d15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0bc expref: 12 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802428.652479:0:14348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0800, rc 0) 00000100:00100000:0.0:1788802428.652555:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+12:13886:x1875694872276736:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 171us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.652563:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:1.0:1788802428.667356:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802428.669526:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872276864 00000100:00100000:3.0:1788802428.669562:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872276864 00000100:00100000:3.0:1788802428.669652:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 95 00000100:00100000:3.0:1788802428.669673:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+12:13886:x1875694872276864:12345-192.168.201.57@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788802428.669703:0:14346:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788802428.669722:0:14346:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788802428.669726:0:14346:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788802428.669730:0:14346:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788802428.669732:0:14346:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788802428.675946:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+12:13886:x1875694872276864:12345-192.168.201.57@tcp:256:mount.lustre.0 Request processed in 6264us (8590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802428.675962:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 95 00000100:00100000:2.0:1788802428.682141:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802428.682226:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872276992 00000100:00100000:3.0:1788802428.682261:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872276992 00000100:00100000:3.0:1788802428.683407:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 96 00000100:00100000:3.0:1788802428.683416:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+12:13886:x1875694872276992:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788802428.683431:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802428.683449:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d165 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edf0c3 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802428.683625:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0c3 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802428.683639:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0c3 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802428.683647:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9600, rc 0) 00000100:00100000:3.0:1788802428.683716:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13886:x1875694872276992:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 300us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802428.683723:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 96 00000100:00100000:1.0:1788802428.687478:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802428.687619:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872277120 00000100:00100000:3.0:1788802428.687629:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872277120 00000100:00100000:3.0:1788802428.687697:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:3.0:1788802428.687709:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13886:x1875694872277120:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788802428.688029:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13886:x1875694872277120:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 320us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802428.688037:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:2.0:1788802428.690541:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802428.690630:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872277248 00000100:00100000:3.0:1788802428.690638:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872277248 00000100:00100000:3.0:1788802428.690706:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:3.0:1788802428.690716:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13886:x1875694872277248:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788802428.690960:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13886:x1875694872277248:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 245us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802428.690973:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:2.0:1788802428.694496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802428.694878:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872277376 00000100:00100000:0.0:1788802428.694889:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872277376 00000100:00100000:0.0:1788802428.694944:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:0.0:1788802428.694954:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13896:x1875694872277376:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788802428.695174:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13896:x1875694872277376:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 221us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.695184:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:1.0:1788802428.715692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802428.717028:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872277504 00000100:00100000:0.0:1788802428.717043:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872277504 00000100:00100000:0.0:1788802428.717119:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:0.0:1788802428.717130:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13896:x1875694872277504:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788802428.717428:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13896:x1875694872277504:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 298us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.717436:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:2.0:1788802428.728936:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802428.728982:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802428.729135:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802428.729205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802428.729297:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872278272 00000100:00100000:2.0:1788802428.729306:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872278272 00000100:00100000:2.0:1788802428.729365:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872278144 00000100:00100000:2.0:1788802428.729368:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872278144 00000100:00100000:2.0:1788802428.729385:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788802428.729395:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2359:x1875694872278272:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802428.729471:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2359:x1875694872278272:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 79us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802428.729478:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788802428.729497:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:2.0:1788802428.729504:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2359:x1875694872278144:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802428.729530:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2359:x1875694872278144:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802428.729537:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:3.0:1788802428.734500:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872277632 00000100:00100000:3.0:1788802428.734518:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872277632 00000100:00100000:3.0:1788802428.734599:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872278016 00000100:00100000:3.0:1788802428.734602:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872278016 00000100:00100000:3.0:1788802428.734636:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:3.0:1788802428.734645:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+7:2359:x1875694872278016:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802428.734846:0:14354:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788802428.734870:0:14354:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788802428.735410:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+7:2359:x1875694872278016:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 761us (6422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802428.735419:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:3.0:1788802428.735442:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788802428.735447:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2356:x1875694872277632:12345-192.168.201.57@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788802428.735472:0:14355:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from df5da259-4b74-472e-93fb-705207586f21@192.168.201.57@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:3.0:1788802428.735520:0:14355:0:(genops.c:1384:class_connect()) connect: client df5da259-4b74-472e-93fb-705207586f21, cookie 0x6ecba1490fc9d16c 00000004:00100000:3.0:1788802428.735561:0:14355:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788802428.737804:0:14355:0:(import.c:65:import_set_state_nolock()) ffff910c02b68800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788802428.737988:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5da259-4b74-472e-93fb-705207586f21+6:2356:x1875694872277632:12345-192.168.201.57@tcp:38:mount.lustre.0 Request processed in 2537us (9063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802428.737998:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:1.0:1788802428.744419:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802428.744683:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872277760 00000100:00100000:3.0:1788802428.744694:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872277760 00000100:00080000:2.0:1788802428.744832:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802428.745671:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788802428.745689:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5da259-4b74-472e-93fb-705207586f21+6:0:x1875694872277760:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788802428.745725:0:14354:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788802428.745821:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5da259-4b74-472e-93fb-705207586f21+6:0:x1875694872277760:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 138us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802428.745829:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:2.0:1788802428.759144:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802428.759416:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872277888 00000100:00100000:3.0:1788802428.759427:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872277888 00000100:00100000:3.0:1788802428.759510:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788802428.759521:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5da259-4b74-472e-93fb-705207586f21+6:13886:x1875694872277888:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788802428.759923:0:14355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788802428.759999:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5da259-4b74-472e-93fb-705207586f21+6:13886:x1875694872277888:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 479us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802428.760007:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:2.0:1788802428.762395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802428.762659:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872278400 00000100:00100000:1.0:1788802428.762670:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872278400 00000100:00100000:1.0:1788802428.762729:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788802428.762739:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5da259-4b74-472e-93fb-705207586f21+6:13886:x1875694872278400:12345-192.168.201.57@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788802428.762974:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5da259-4b74-472e-93fb-705207586f21+6:13886:x1875694872278400:12345-192.168.201.57@tcp:40:mount.lustre.0 Request processed in 235us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802428.762981:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788802428.770892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802428.770979:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802428.771009:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802428.771075:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872278528 00000100:00100000:3.0:1788802428.771084:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872278528 00000100:00100000:3.0:1788802428.771183:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872278656 00000100:00100000:3.0:1788802428.771186:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872278656 00000100:00100000:1.0:1788802428.771225:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:1.0:1788802428.771233:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1875694872278528:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788802428.771291:0:15039:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from df5da259-4b74-472e-93fb-705207586f21@192.168.201.57@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:1.0:1788802428.771320:0:15039:0:(genops.c:1384:class_connect()) connect: client df5da259-4b74-472e-93fb-705207586f21, cookie 0x6ecba1490fc9d173 00002000:00100000:1.0:1788802428.771330:0:15039:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df5da259-4b74-472e-93fb-705207586f21/ffff910d037d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788802428.771340:0:15039:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788802428.771586:0:15039:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788802428.771613:0:15039:0:(import.c:65:import_set_state_nolock()) ffff910d037d6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788802428.771671:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+6:2356:x1875694872278528:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 438us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802428.771678:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:1.0:1788802428.771697:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:1.0:1788802428.771701:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1875694872278656:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788802428.771738:0:15039:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from df5da259-4b74-472e-93fb-705207586f21@192.168.201.57@tcp t0 exp 0000000000000000 cur 481 last 0 00000100:00100000:0.0:1788802428.771855:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872278784 00000100:00100000:0.0:1788802428.771859:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872278784 00000100:00100000:0.0:1788802428.771888:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:0.0:1788802428.771895:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df5da259-4b74-472e-93fb-705207586f21+6:13886:x1875694872278784:12345-192.168.201.57@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788802428.771951:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788802428.771989:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df5da259-4b74-472e-93fb-705207586f21+6:13886:x1875694872278784:12345-192.168.201.57@tcp:33:mount.lustre.0 Request processed in 95us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802428.771995:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000020:00000080:1.0:1788802428.772630:0:15039:0:(genops.c:1384:class_connect()) connect: client df5da259-4b74-472e-93fb-705207586f21, cookie 0x6ecba1490fc9d17a 00002000:00100000:1.0:1788802428.772639:0:15039:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df5da259-4b74-472e-93fb-705207586f21/ffff910d037d7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788802428.772648:0:15039:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788802428.772881:0:15039:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788802428.772901:0:15039:0:(import.c:65:import_set_state_nolock()) ffff910d037d4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788802428.772935:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+6:2356:x1875694872278656:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 1232us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802428.772943:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:2.0:1788802429.058877:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802429.059129:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872278912 00000100:00100000:0.0:1788802429.059139:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872278912 00000100:00100000:0.0:1788802429.059199:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:0.0:1788802429.059216:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5da259-4b74-472e-93fb-705207586f21+6:13917:x1875694872278912:12345-192.168.201.57@tcp:101:mkdir.0 00010000:00010000:0.0:1788802429.059270:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802429.059295:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf0ed expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802429.059357:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802429.059385:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802429.059401:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802429.059436:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788802429.059441:0:14353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802429.059460:0:14353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802429.059499:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0ed expref: 8 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802429.059516:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0ed expref: 7 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802429.059524:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6900) 00010000:00010000:0.0:1788802429.059527:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788802429.059531:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0c00, rc 0) 00000100:00100000:0.0:1788802429.059659:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5da259-4b74-472e-93fb-705207586f21+7:13917:x1875694872278912:12345-192.168.201.57@tcp:101:mkdir.0 Request processed in 450us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802429.059666:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00010000:00010000:2.0:1788802429.516504:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788802430.426866:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 364c129c-855f-4ad1-8a13-12da787d546b 00000001:00100000:1.0:1788802430.427132:0:5865:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df5da259-4b74-472e-93fb-705207586f21 00010000:00010000:2.0:1788802430.542078:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788802430.861556:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892193152:0@lo:400:kworker.0 00000100:00100000:1.0:1788802430.861633:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802430.861691:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788802430.861698:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892193280:0@lo:400:kworker.0 00000100:00100000:1.0:1788802430.861734:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802430.861768:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892193280 00000100:00100000:1.0:1788802430.861775:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892193280 00000100:00100000:1.0:1788802430.861818:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788802430.861827:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892193280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802430.861876:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892193280:12345-0@lo:400:kworker.0 Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802430.861883:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788802430.861927:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892193280:0@lo:400:kworker.0 00000100:00100000:3.0:1788802430.862447:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892193024:0@lo:400:kworker.0 00000100:00100000:3.0:1788802430.862481:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802430.862505:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892193536:0@lo:400:kworker.0 00000100:00100000:3.0:1788802430.862537:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802430.862568:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788802430.862574:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892192896:0@lo:400:kworker.0 00000100:00100000:3.0:1788802430.862602:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802430.862627:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892193408:0@lo:400:kworker.0 00000100:00100000:3.0:1788802430.862647:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802430.862673:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892193536 00000100:00100000:3.0:1788802430.862677:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892193536 00000100:00100000:3.0:1788802430.862723:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892193408 00000100:00100000:3.0:1788802430.862726:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892193408 00000100:00100000:3.0:1788802430.862746:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788802430.862751:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892193536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802430.862792:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892193536:12345-0@lo:400:kworker.0 Request processed in 41us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802430.862799:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788802430.862813:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788802430.862819:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892193408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802430.862845:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892193408:12345-0@lo:400:kworker.0 Request processed in 27us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802430.862850:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788802430.862868:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892192896 00000100:00100000:3.0:1788802430.862871:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892192896 00000100:00100000:3.0:1788802430.862895:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788802430.862901:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:3314:x1875694892192896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802430.862940:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:3314:x1875694892192896:12345-0@lo:400:kworker.0 Request processed in 39us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802430.862946:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788802430.862986:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892192896:0@lo:400:kworker.0 00000100:00100000:3.0:1788802430.862998:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892193408:0@lo:400:kworker.0 00000100:00100000:3.0:1788802430.863008:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892193536:0@lo:400:kworker.0 00000100:00080000:2.0:1788802430.863600:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802430.863642:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788802430.863654:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892193664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802430.863688:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802430.863731:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892193664 00000100:00100000:2.0:1788802430.863736:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892193664 00000100:00100000:2.0:1788802430.863772:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788802430.863780:0:15041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892193664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788802430.863809:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802430.863852:0:15041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892193664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802430.863859:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788802430.863875:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802430.863901:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892193664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802430.863923:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892193152 00000100:00100000:2.0:1788802430.863927:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892193152 00000100:00100000:2.0:1788802430.863952:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892193024 00000100:00100000:2.0:1788802430.863955:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892193024 00000100:00100000:2.0:1788802430.863968:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802430.863974:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892193152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802430.864003:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892193152:12345-0@lo:400:kworker.0 Request processed in 30us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802430.864009:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802430.864020:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788802430.864025:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892193024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802430.864056:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892193024:12345-0@lo:400:kworker.0 Request processed in 31us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802430.864064:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788802430.864076:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788802430.864095:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788802430.864130:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892193152:0@lo:400:kworker.0 00000100:00100000:2.0:1788802430.864156:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892193024:0@lo:400:kworker.0 00000100:00100000:1.0:1788802430.864854:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892193792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802430.864894:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802430.864969:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892193792 00000100:00100000:1.0:1788802430.864973:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892193792 00000100:00100000:1.0:1788802430.865005:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788802430.865013:0:15041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892193792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802430.865037:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802430.865073:0:15041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892193792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802430.865080:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788802430.865122:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892193792:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788802430.975943:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df5da259-4b74-472e-93fb-705207586f21 00000001:00100000:2.0:1788802431.004535:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df5da259-4b74-472e-93fb-705207586f21 00010000:00010000:2.0:1788802431.571372:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802432.588781:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802433.613765:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802434.036006:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802434.036054:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802434.036143:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802434.036176:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872279296 00000100:00100000:2.0:1788802434.036186:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872279296 00000100:00100000:2.0:1788802434.036278:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788802434.036303:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2360:x1875694872279296:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802434.036377:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2360:x1875694872279296:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802434.036385:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00080000:2.0:1788802434.036408:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802434.036739:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872279168 00000100:00100000:3.0:1788802434.036746:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872279168 00000100:00100000:3.0:1788802434.036782:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:3.0:1788802434.036791:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+6:2360:x1875694872279168:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802434.036828:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+6:2360:x1875694872279168:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 39us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802434.036835:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00080000:3.0:1788802434.036856:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802434.036882:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802434.037115:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872279424 00000100:00100000:1.0:1788802434.037132:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872279424 00000100:00100000:1.0:1788802434.037164:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:1.0:1788802434.037172:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+5:2360:x1875694872279424:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788802434.037205:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+5:2360:x1875694872279424:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 35us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802434.037210:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00080000:1.0:1788802434.037224:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788802434.037643:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872279040 00000100:00100000:0.0:1788802434.037649:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872279040 00000100:00100000:0.0:1788802434.037691:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:0.0:1788802434.037699:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d1d046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:2360:x1875694872279040:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802434.037735:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d1d046050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:2360:x1875694872279040:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 37us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802434.037747:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:1.0:1788802434.050863:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802434.050920:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872279552 00000100:00100000:1.0:1788802434.050920:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802434.050931:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872279552 00000100:00080000:1.0:1788802434.050973:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802434.050991:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:2.0:1788802434.051001:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5da259-4b74-472e-93fb-705207586f21+6:2360:x1875694872279552:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802434.051024:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872279680 00000100:00100000:3.0:1788802434.051028:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872279680 00000100:00100000:3.0:1788802434.051061:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788802434.051068:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5da259-4b74-472e-93fb-705207586f21+5:2359:x1875694872279680:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802434.051074:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5da259-4b74-472e-93fb-705207586f21+6:2360:x1875694872279552:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802434.051094:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df5da259-4b74-472e-93fb-705207586f21+5:2359:x1875694872279680:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 27us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802434.051107:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788802434.054840:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00080000:0.0:1788802434.058733:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788802434.058760:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872279808 00000100:00100000:0.0:1788802434.058771:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872279808 00000100:00100000:0.0:1788802434.058834:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788802434.058844:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+5:2359:x1875694872279808:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802434.058935:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+5:2359:x1875694872279808:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 91us (4104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802434.058942:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00080000:0.0:1788802434.058960:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788802434.062570:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000001:02000400:3.0:1788802434.343995:0:16319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788802434.636605:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788802435.661452:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802435.982012:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892193920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802435.982092:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802435.982154:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892194048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802435.982178:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802435.982266:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892193920 00000100:00100000:1.0:1788802435.982276:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892193920 00000100:00100000:1.0:1788802435.982333:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892194048 00000100:00100000:1.0:1788802435.982336:0:15041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892194048 00000100:00100000:1.0:1788802435.982372:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788802435.982381:0:15041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892193920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802435.982427:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788802435.982447:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788802435.982451:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788802435.982477:0:15041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892193920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802435.982485:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788802435.982501:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788802435.982506:0:15041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892194048:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802435.982508:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892193920:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788802435.982524:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788802435.982555:0:15041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892194048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802435.982561:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788802435.982577:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892194048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802435.984202:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875694892194432:0@lo:400:kworker.0 00000100:00100000:2.0:1788802435.984434:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892194304:0@lo:400:kworker.0 00000100:00100000:1.0:1788802435.984526:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892194560:0@lo:400:kworker.0 00000100:00100000:2.0:1788802435.984578:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802435.984614:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802435.984663:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892194176:0@lo:400:kworker.0 00000100:00100000:2.0:1788802435.984705:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802435.984778:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802435.984875:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892194176 00000100:00100000:1.0:1788802435.984887:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892194176 00000100:00100000:2.0:1788802435.984891:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892194304 00000100:00100000:2.0:1788802435.984900:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892194304 00000100:00100000:2.0:1788802435.984961:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892194560 00000100:00100000:1.0:1788802435.984966:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788802435.984977:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892194560 00000100:00100000:1.0:1788802435.984985:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:3314:x1875694892194176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802435.985015:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892194432 00000100:00100000:2.0:1788802435.985019:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892194432 00000100:00100000:2.0:1788802435.985047:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788802435.985058:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892194304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802435.985070:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:3314:x1875694892194176:12345-0@lo:400:kworker.0 Request processed in 92us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802435.985078:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788802435.985130:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892194304:12345-0@lo:400:kworker.0 Request processed in 71us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802435.985138:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788802435.985159:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788802435.985165:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892194560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788802435.985207:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875694892194560:12345-0@lo:400:kworker.0 Request processed in 43us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802435.985216:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788802435.985368:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788802435.985383:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875694892194432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802435.985391:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875694892194560:0@lo:400:kworker.0 00000100:00100000:2.0:1788802435.985445:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875694892194432:12345-0@lo:400:kworker.0 Request processed in 67us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802435.985660:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788802435.985700:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802435.985741:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892194176:0@lo:400:kworker.0 00000100:00100000:2.0:1788802435.985787:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892194304:0@lo:400:kworker.0 00000100:00100000:2.0:1788802435.985825:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875694892194432:0@lo:400:kworker.0 00000040:00080000:3.0:1788802436.047304:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788802436.717460:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802437.772846:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802438.799229:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788802438.808832:0:16467:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec1255aa0 20000000:00000080:3.0:1788802438.808853:0:16467:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff910c02b7c800 uarg=0000000000000000 20000000:01000000:3.0:1788802438.808900:0:16467:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788802438.808908:0:16467:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788802438.808914:0:16467:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788802438.817356:0:16468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788802438.823261:0:16467:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788802438.833496:0:16467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788802438.833806:0:16467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.833831:0:16467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3eee9400/0x6ecba1490fc9ce86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9ce7f expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.833861:0:16467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ced3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9cecc expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.833868:0:16467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d4216fc00/0x6ecba1490fc9d00e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9d007 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.833880:0:16467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d12d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf061 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.833887:0:16467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d165 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0c3 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.833895:0:16467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.833955:0:16467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0c3 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.833976:0:16467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d165 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0c3 expref: 12 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802438.833998:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875694892194688:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802438.834219:0:16467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d12d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf061 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.834229:0:16467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d12d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf061 expref: 12 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802438.834271:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875694892194816:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802438.834331:0:16467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216fc00/0x6ecba1490fc9d00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9d007 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.834340:0:16467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d4216fc00/0x6ecba1490fc9d00e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9d007 expref: 18 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802438.834350:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875694892194944:0@lo:104: 00000100:00100000:0.0:1788802438.834437:0:16467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788802438.834523:0:16467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ced3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9cecc expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.834533:0:16467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ced3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9cecc expref: 18 pid: 14346 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802438.834578:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082ebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875694892195072:0@lo:104: 00000100:00100000:0.0:1788802438.834625:0:16467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802438.834738:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892194944 00000100:00100000:0.0:1788802438.834771:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892194944 00000100:00100000:0.0:1788802438.834926:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892195072 00000100:00100000:0.0:1788802438.834931:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892195072 00000100:00100000:0.0:1788802438.835015:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788802438.835026:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+4:16467:x1875694892194944:12345-0@lo:104: 00010000:00010000:0.0:1788802438.835044:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835100:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788802438.835106:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+4:16467:x1875694892194944:12345-0@lo:104: Request processed in 82us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802438.835114:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788802438.835144:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788802438.835150:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+3:16467:x1875694892195072:12345-0@lo:104: 00010000:00010000:0.0:1788802438.835159:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835211:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788802438.835217:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+3:16467:x1875694892195072:12345-0@lo:104: Request processed in 68us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802438.835224:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788802438.835314:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788802438.835320:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835334:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0000 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802438.835425:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835483:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802438.835522:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802438.835543:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788802438.835616:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835623:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802438.835646:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835668:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d206f0000/0x6ecba1490fc9d007 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9d00e expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835685:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802438.835688:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835694:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d4216fa00 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802438.835697:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835704:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802438.835710:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802438.835716:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788802438.835730:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835737:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802438.835751:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835756:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d4216fa00/0x6ecba1490fc9cecc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ced3 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835766:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802438.835775:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802438.835777:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802438.835807:0:16467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff910d3eee9400/0x6ecba1490fc9ce86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6ecba1490fc9ce7f expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.835818:0:16467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff910d3eee9400/0x6ecba1490fc9ce86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce7f expref: 18 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802438.835830:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875694892195456:0@lo:104: 00000100:00100000:0.0:1788802438.835872:0:16467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802438.835910:0:14336:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788802438.835972:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892195456 00000100:00100000:0.0:1788802438.835979:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892195456 00000100:00100000:0.0:1788802438.836032:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788802438.836058:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+3:16467:x1875694892195456:12345-0@lo:104: 00010000:00010000:0.0:1788802438.836081:0:14336:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.836166:0:14336:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788802438.836187:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:87cc913b-814f-413d-b622-408baef57c45+3:16467:x1875694892195456:12345-0@lo:104: Request processed in 139us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802438.836225:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788802438.836452:0:14342:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802438.836457:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.836464:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2800 already unused, calling callback (ffffffffc1d69c20) 10000000:00010000:0.0:1788802438.836467:0:14342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.836487:0:14342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788802438.836493:0:14342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788802438.836499:0:14342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788802438.836517:0:14342:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.836522:0:14342:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788802438.836531:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.836538:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff910d3a0f2800/0x6ecba1490fc9ce7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6ecba1490fc9ce86 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.836555:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802438.836557:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802438.836559:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802438.836574:0:16467:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3be47840 going to sleep for 11 seconds 00000100:00100000:0.0:1788802438.836631:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875694892194944:0@lo:104: 00000100:00100000:0.0:1788802438.836644:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082ebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875694892195072:0@lo:104: 00000100:00100000:0.0:1788802438.836652:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875694892195456:0@lo:104: 00010000:00010000:2.0:1788802438.837700:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802438.837728:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892195200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802438.837803:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802438.837871:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87cc913b-814f-413d-b622-408baef57c45:3311:1875694892195328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802438.837898:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802438.837927:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788802438.837933:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87cc913b-814f-413d-b622-408baef57c45:3311:1875694892195584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802438.837959:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802438.838020:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892195200 00000100:00100000:2.0:1788802438.838029:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892195200 00010000:00010000:2.0:1788802438.838068:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216fc00/0x6ecba1490fc9d00e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9d007 expref: 19 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802438.838091:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892195328 00000100:00100000:2.0:1788802438.838095:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892195328 00010000:00010000:2.0:1788802438.838124:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ced3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9cecc expref: 20 pid: 14346 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802438.838155:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892195584 00000100:00100000:2.0:1788802438.838158:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892195584 00010000:00010000:2.0:1788802438.838183:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3eee9400/0x6ecba1490fc9ce86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce7f expref: 21 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802438.838212:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788802438.838220:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87cc913b-814f-413d-b622-408baef57c45+21:3314:x1875694892195200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788802438.838330:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802438.838338:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216fc00/0x6ecba1490fc9d00e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9d007 expref: 21 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802438.838349:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216fc00/0x6ecba1490fc9d00e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9d007 expref: 21 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802438.838392:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216fc00/0x6ecba1490fc9d00e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9d007 expref: 21 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802438.838410:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802438.838449:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87cc913b-814f-413d-b622-408baef57c45+20:3314:x1875694892195200:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802438.838457:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788802438.838477:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788802438.838483:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87cc913b-814f-413d-b622-408baef57c45+19:3311:x1875694892195328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788802438.838492:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802438.838496:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ced3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9cecc expref: 19 pid: 14346 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802438.838506:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ced3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9cecc expref: 19 pid: 14346 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802438.838515:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d4216ee00/0x6ecba1490fc9ced3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9cecc expref: 19 pid: 14346 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802438.838524:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802438.838551:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87cc913b-814f-413d-b622-408baef57c45+18:3311:x1875694892195328:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802438.838557:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788802438.838569:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802438.838574:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87cc913b-814f-413d-b622-408baef57c45+17:3311:x1875694892195584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788802438.838582:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802438.838586:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3eee9400/0x6ecba1490fc9ce86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce7f expref: 17 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802438.838601:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3eee9400/0x6ecba1490fc9ce86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6ecba1490fc9ce7f expref: 17 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802438.838612:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3eee9400/0x6ecba1490fc9ce86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6ecba1490fc9ce7f expref: 17 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802438.838621:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802438.838645:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87cc913b-814f-413d-b622-408baef57c45+16:3311:x1875694892195584:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802438.838652:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788802438.838721:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87cc913b-814f-413d-b622-408baef57c45:3311:1875694892195584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802438.838732:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:87cc913b-814f-413d-b622-408baef57c45:3311:1875694892195328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788802438.838763:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892195200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788802438.844835:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802438.844876:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802438.844991:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872279936 00000100:00100000:1.0:1788802438.845005:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872279936 00010000:00010000:1.0:1788802438.845069:0:14338:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d165 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0c3 expref: 13 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802438.845117:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872280064 00000100:00100000:1.0:1788802438.845121:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872280064 00010000:00010000:1.0:1788802438.845135:0:14338:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d12d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf061 expref: 14 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802438.845151:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:1.0:1788802438.845162:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b2e0225-aaaf-4b10-912e-97a2922a7720+14:2359:x1875694872279936:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802438.845182:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802438.845189:0:14338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d165 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0c3 expref: 14 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845203:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d165 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0c3 expref: 14 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845230:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802438.845339:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b2e0225-aaaf-4b10-912e-97a2922a7720+14:2359:x1875694872279936:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 179us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802438.845347:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:1.0:1788802438.845379:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:1.0:1788802438.845386:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:2359:x1875694872280064:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802438.845394:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802438.845399:0:14338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d12d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf061 expref: 13 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845409:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d12d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf061 expref: 13 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845432:0:14338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845442:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845463:0:14338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845472:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845480:0:14338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845487:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845495:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1c00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:1.0:1788802438.845500:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845509:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845518:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802438.845531:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802438.845553:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:2359:x1875694872280064:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 168us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802438.845569:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00010000:00010000:0.0:1788802438.846180:0:16467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d165 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0c3 expref: 12 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802438.846199:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875694892194688:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802438.846224:0:16467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d12d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf061 expref: 11 pid: 14347 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802438.846233:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875694892194816:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802438.846385:0:16467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.846396:0:16467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.846402:0:16467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802438.846409:0:16467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d18f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802439.160007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802439.160051:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802439.160080:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802439.160105:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802439.160127:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802439.160156:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802439.160186:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872280192 00000100:00100000:3.0:1788802439.160198:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872280192 00000100:00100000:3.0:1788802439.160308:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872280576 00000100:00100000:3.0:1788802439.160312:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872280576 00000100:00100000:3.0:1788802439.160341:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:3.0:1788802439.160353:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+6:2359:x1875694872280192:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802439.160468:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+6:2359:x1875694872280192:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 117us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802439.160476:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:3.0:1788802439.160499:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:3.0:1788802439.160504:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5da259-4b74-472e-93fb-705207586f21+6:2359:x1875694872280576:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802439.160550:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5da259-4b74-472e-93fb-705207586f21+6:2359:x1875694872280576:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 46us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802439.160557:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:3.0:1788802439.160578:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872280448 00000100:00100000:3.0:1788802439.160583:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872280448 00000100:00100000:3.0:1788802439.160605:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872280704 00000100:00100000:3.0:1788802439.160608:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872280704 00000100:00100000:3.0:1788802439.160618:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872280320 00000100:00100000:3.0:1788802439.160620:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872280320 00000100:00100000:3.0:1788802439.160632:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872280832 00000100:00100000:3.0:1788802439.160634:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872280832 00000100:00100000:3.0:1788802439.160664:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788802439.160670:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+5:2359:x1875694872280448:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802439.160696:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+5:2359:x1875694872280448:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 26us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802439.160702:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788802439.160713:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:3.0:1788802439.160719:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+5:2359:x1875694872280704:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802439.160739:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+5:2359:x1875694872280704:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 21us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802439.160744:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:3.0:1788802439.160753:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:3.0:1788802439.160758:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+5:2359:x1875694872280320:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802439.160774:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+5:2359:x1875694872280320:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 17us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802439.160789:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:3.0:1788802439.160799:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788802439.160805:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+5:2359:x1875694872280832:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802439.160827:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+5:2359:x1875694872280832:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 22us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802439.160832:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00080000:2.0:1788802439.163268:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788802439.163280:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788802439.163285:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788802439.825804:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788802439.884467:0:14350:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788802439.884479:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d0450b800 from 10 10000000:01000000:3.0:1788802439.884486:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788802439.884562:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee8000/0x6ecba1490fc9d196 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.884576:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3eee8000/0x6ecba1490fc9d196 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.884599:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3eee8000/0x6ecba1490fc9d196 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802439.884635:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892195712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788802439.884722:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802439.884791:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d112433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802439.884969:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892195712 00000100:00100000:0.0:1788802439.884978:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892195712 00000100:00100000:0.0:1788802439.885046:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788802439.885058:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+16:14350:x1875694892195712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788802439.885074:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802439.885092:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d19d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9d196 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802439.885121:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d19d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9d196 expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802439.885135:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f1c00/0x6ecba1490fc9d19d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9d196 expref: 17 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802439.885161:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1c00, rc 0) 00000100:00100000:0.0:1788802439.885211:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+17:14350:x1875694892195712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802439.885217:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788802439.885396:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892195712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788802439.885414:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3eee8000/0x6ecba1490fc9d196 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d19d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802439.885423:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3eee8000/0x6ecba1490fc9d196 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9d19d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802439.885487:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892195840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802439.885514:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802439.885530:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3be47f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788802439.885543:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892195840 00000100:00100000:0.0:1788802439.885547:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892195840 00000100:00100000:0.0:1788802439.885570:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788802439.885576:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+17:14350:x1875694892195840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802439.885957:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+17:14350:x1875694892195840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802439.885965:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788802439.885997:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892195840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802439.886028:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892195968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802439.886070:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802439.886092:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3be47f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788802439.886104:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892195968 00000100:00100000:0.0:1788802439.886108:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892195968 00000100:00100000:0.0:1788802439.886131:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788802439.886137:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+17:14350:x1875694892195968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802439.887529:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+17:14350:x1875694892195968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1385us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802439.887541:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788802439.887689:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892195968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788802439.889904:0:16492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788802439.894784:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788802439.894828:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788802439.894842:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee8000/0x6ecba1490fc9d196 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d19d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.894856:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3eee8000/0x6ecba1490fc9d196 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d19d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802439.894884:0:14350:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788802439.894888:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d030ff000 from 10 10000000:01000000:3.0:1788802439.895011:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788802439.895065:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee9200/0x6ecba1490fc9d1a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.895073:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3eee9200/0x6ecba1490fc9d1a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.895086:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3eee9200/0x6ecba1490fc9d1a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802439.895117:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788802439.895206:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802439.895471:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243540 going to sleep for 11 seconds 00000100:00100000:1.0:1788802439.895731:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892196096 00000100:00100000:1.0:1788802439.895742:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892196096 00000100:00100000:1.0:1788802439.895808:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788802439.895820:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+17:14350:x1875694892196096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788802439.895838:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802439.895855:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d1ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9d1a4 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802439.895884:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9d1a4 expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802439.896001:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3a0f2200/0x6ecba1490fc9d1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9d1a4 expref: 18 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802439.896013:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2200, rc 0) 00000100:00100000:1.0:1788802439.896069:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+18:14350:x1875694892196096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802439.896075:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788802439.896192:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802439.896209:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3eee9200/0x6ecba1490fc9d1a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d1ab expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.896404:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3eee9200/0x6ecba1490fc9d1a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9d1ab expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802439.896486:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802439.896518:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802439.896596:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243540 going to sleep for 11 seconds 00000100:00100000:0.0:1788802439.901736:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892196224 00000100:00100000:0.0:1788802439.901758:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892196224 00000100:00100000:0.0:1788802439.901847:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788802439.901861:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+18:14350:x1875694892196224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802439.903488:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+18:14350:x1875694892196224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1622us (6959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802439.903503:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788802439.903900:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802439.903978:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802439.904053:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802439.904098:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243540 going to sleep for 11 seconds 00000100:00100000:1.0:1788802439.904694:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892196352 00000100:00100000:1.0:1788802439.904703:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892196352 00000100:00100000:1.0:1788802439.904753:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788802439.904763:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+18:14350:x1875694892196352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788802439.904997:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+18:14350:x1875694892196352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802439.905005:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788802439.905100:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788802439.909013:0:16493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788802439.909195:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788802439.909234:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788802439.909536:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee9200/0x6ecba1490fc9d1a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d1ab expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.909560:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3eee9200/0x6ecba1490fc9d1a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d1ab expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788802439.909573:0:14350:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788802439.909577:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff910d3f90d800 from 10 10000000:01000000:3.0:1788802439.909588:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788802439.909638:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee8400/0x6ecba1490fc9d1b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.909647:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff910d3eee8400/0x6ecba1490fc9d1b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.909661:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff910d3eee8400/0x6ecba1490fc9d1b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802439.909694:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788802439.909782:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802439.909834:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243540 going to sleep for 11 seconds 00000100:00100000:0.0:1788802439.909952:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892196480 00000100:00100000:0.0:1788802439.909962:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892196480 00000100:00100000:0.0:1788802439.910023:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788802439.910034:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+18:14350:x1875694892196480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788802439.910051:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802439.910067:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d1b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6ecba1490fc9d1b2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802439.910094:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6ecba1490fc9d1b2 expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802439.910107:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d206f1000/0x6ecba1490fc9d1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6ecba1490fc9d1b2 expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802439.910130:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1000, rc 0) 00000100:00100000:0.0:1788802439.910181:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:14350:x1875694892196480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802439.910189:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788802439.910775:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802439.910794:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff910d3eee8400/0x6ecba1490fc9d1b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d1b9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.910814:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff910d3eee8400/0x6ecba1490fc9d1b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6ecba1490fc9d1b9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802439.910884:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802439.910919:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802439.910988:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d11243540 going to sleep for 11 seconds 00000100:00100000:0.0:1788802439.915849:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892196608 00000100:00100000:0.0:1788802439.915872:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892196608 00000100:00100000:1.0:1788802439.916020:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788802439.916045:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+19:14350:x1875694892196608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788802439.916524:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:87cc913b-814f-413d-b622-408baef57c45+19:14350:x1875694892196608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 482us (5603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802439.916533:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788802439.917436:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788802439.917514:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04543b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788802439.917611:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802439.917660:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d418fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788802439.917876:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892196736 00000100:00100000:0.0:1788802439.917884:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892196736 00000100:00100000:0.0:1788802439.917939:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788802439.917950:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:14350:x1875694892196736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802439.918159:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:14350:x1875694892196736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802439.918166:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788802439.918879:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04543b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:87cc913b-814f-413d-b622-408baef57c45:14350:1875694892196736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788802439.920162:0:16495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:0.0:1788802439.925897:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802439.926106:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872280960 00000100:00100000:3.0:1788802439.926121:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872280960 00000100:00100000:3.0:1788802439.926191:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:3.0:1788802439.926204:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+11:13769:x1875694872280960:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802439.926258:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802439.926445:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee9000/0x6ecba1490fc9d1c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edf0f4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.926483:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee9000/0x6ecba1490fc9d1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0f4 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.926495:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee9000/0x6ecba1490fc9d1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0f4 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.926506:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9000, rc 0) 00000100:00100000:3.0:1788802439.926706:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+12:13769:x1875694872280960:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 504us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802439.926714:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:3.0:1788802439.929097:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802439.929271:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872281088 00000100:00100000:0.0:1788802439.929292:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872281088 00000100:00100000:0.0:1788802439.929361:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:0.0:1788802439.929373:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+12:13769:x1875694872281088:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788802439.929854:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+12:13769:x1875694872281088:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 482us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802439.929863:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 114 00000100:00100000:0.0:1788802439.931786:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802439.931900:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872281216 00000100:00100000:3.0:1788802439.931910:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872281216 00000100:00100000:3.0:1788802439.931967:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:3.0:1788802439.931978:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+12:13769:x1875694872281216:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788802439.932468:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+12:13769:x1875694872281216:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 491us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802439.932477:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 115 00000020:01000000:2.0:1788802439.932756:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788802439.932796:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788802439.932810:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff910d3eee8400/0x6ecba1490fc9d1b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d1b9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802439.932823:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff910d3eee8400/0x6ecba1490fc9d1b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6ecba1490fc9d1b9 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802439.941760:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802439.942665:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872281344 00000100:00100000:3.0:1788802439.942681:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872281344 00000100:00100000:3.0:1788802439.942771:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 116 00000100:00100000:3.0:1788802439.942784:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+12:13769:x1875694872281344:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788802439.942809:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802439.942836:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d1c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d80875826edf0fb expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.942872:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d1c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0fb expref: 13 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.942884:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff910d3eee9600/0x6ecba1490fc9d1c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0fb expref: 13 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802439.942893:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3eee9600, rc 0) 00000100:00100000:3.0:1788802439.942966:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13769:x1875694872281344:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 185us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802439.942973:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 116 00000100:00100000:0.0:1788802439.949800:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802439.950183:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872281472 00000100:00100000:3.0:1788802439.950198:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872281472 00000100:00100000:3.0:1788802439.950477:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:3.0:1788802439.950490:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13769:x1875694872281472:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788802439.950888:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13769:x1875694872281472:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 399us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802439.950898:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:1.0:1788802439.961989:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802439.962959:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872281600 00000100:00100000:0.0:1788802439.962987:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872281600 00000100:00100000:0.0:1788802439.964492:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 118 00000100:00100000:0.0:1788802439.964514:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3ef35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13769:x1875694872281600:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788802439.964828:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3ef35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:13769:x1875694872281600:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 321us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802439.964837:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 118 00010000:00010000:2.0:1788802440.850500:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802441.100627:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892196992:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.100726:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802441.100795:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892197504:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.100841:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802441.100872:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788802441.100877:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892196864:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.100909:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802441.100935:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892197376:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.100958:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802441.100988:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d33db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892197120:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101012:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802441.101031:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788802441.101036:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910c02fa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892197248:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101061:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802441.101097:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892196992 00000100:00100000:3.0:1788802441.101108:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892196992 00000100:00100000:3.0:1788802441.101190:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892197120 00000100:00100000:3.0:1788802441.101194:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892197120 00000100:00100000:3.0:1788802441.101215:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788802441.101225:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892196992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101357:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892196992:12345-0@lo:400:kworker.0 Request processed in 134us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802441.101366:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788802441.101386:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788802441.101393:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892197120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101425:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875694892197120:12345-0@lo:400:kworker.0 Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802441.101431:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788802441.101452:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892197504 00000100:00100000:3.0:1788802441.101456:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892197504 00000100:00100000:3.0:1788802441.101486:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892197376 00000100:00100000:3.0:1788802441.101489:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892197376 00000100:00100000:3.0:1788802441.101502:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892197248 00000100:00100000:3.0:1788802441.101504:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892197248 00000100:00100000:3.0:1788802441.101517:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788802441.101522:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892197504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101553:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892197504:12345-0@lo:400:kworker.0 Request processed in 30us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802441.101559:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788802441.101572:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788802441.101578:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910c02fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892197376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101604:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910c02fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875694892197376:12345-0@lo:400:kworker.0 Request processed in 26us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802441.101610:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788802441.101621:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788802441.101626:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892197248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101666:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875694892197248:12345-0@lo:400:kworker.0 Request processed in 40us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802441.101672:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788802441.101694:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892196864 00000100:00100000:3.0:1788802441.101698:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892196864 00000100:00100000:3.0:1788802441.101725:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788802441.101732:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3588a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:3314:x1875694892196864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101762:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3588a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:87cc913b-814f-413d-b622-408baef57c45+19:3314:x1875694892196864:12345-0@lo:400:kworker.0 Request processed in 31us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802441.101768:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1788802441.101809:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788802441.101814:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788802441.101817:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802441.101942:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875694892197248:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101954:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875694892197120:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101986:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:87cc913b-814f-413d-b622-408baef57c45:3314:1875694892196864:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.101995:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875694892197376:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.102005:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d33db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892196992:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.102013:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910c02fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892197504:0@lo:400:kworker.0 00000100:00100000:3.0:1788802441.104450:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788802441.104476:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892197632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788802441.104954:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802441.105189:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892197632 00000100:00100000:0.0:1788802441.105202:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892197632 00000100:00100000:0.0:1788802441.105294:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788802441.105305:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892197632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788802441.105360:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802441.105427:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892197632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802441.105435:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788802441.106078:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892197632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802441.110688:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892197760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788802441.110786:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802441.112116:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892197760 00000100:00100000:3.0:1788802441.112131:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892197760 00000100:00100000:3.0:1788802441.112211:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788802441.112223:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892197760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788802441.112302:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788802441.112408:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892197760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802441.112416:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788802441.114912:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892197760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788802441.875627:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802442.893078:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788802443.794465:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802443.795156:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872281728 00000100:00100000:3.0:1788802443.795172:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872281728 00000100:00100000:3.0:1788802443.795340:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788802443.795353:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+6:14428:x1875694872281728:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788802443.795382:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802443.795414:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9d1ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf102 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.795695:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9d1d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.795715:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.795733:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.795755:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.795763:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.795858:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797101:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681800/0x6ecba1490fc9d1e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797123:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681800/0x6ecba1490fc9d1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797135:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681800/0x6ecba1490fc9d1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802443.797176:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788802443.797180:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802443.797254:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681800/0x6ecba1490fc9d1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797268:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797275:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797292:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9d1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797299:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3eee8600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802443.797303:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9d1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797312:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9d1d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797342:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6900) 00010000:00010000:3.0:1788802443.797345:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802443.797352:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9d1d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797358:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee8600/0x6ecba1490fc9d1d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797375:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797381:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797387:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797392:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802443.797396:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797401:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797409:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff910d02e21700) 00010000:00010000:3.0:1788802443.797411:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802443.797414:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797419:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.797496:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3eee9400/0x6ecba1490fc9d1ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf102 expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788802443.797669:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788802443.798650:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681800/0x6ecba1490fc9d1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf102 expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.798665:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910d02e21b00) 00010000:00010000:3.0:1788802443.798668:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788802443.798671:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01681800, rc 0) 00000100:00100000:3.0:1788802443.798991:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+7:14428:x1875694872281728:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 3425us (4338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802443.799005:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:1.0:1788802443.808789:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802443.808989:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872281984 00000100:00100000:3.0:1788802443.809004:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872281984 00000100:00100000:3.0:1788802443.809090:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:3.0:1788802443.809103:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+7:14428:x1875694872281984:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788802443.809132:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802443.809701:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf109 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.809931:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d1f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.809949:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.809963:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.809998:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d1f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.810006:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.810012:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.811079:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680c00/0x6ecba1490fc9d1ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.811100:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680c00/0x6ecba1490fc9d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.811111:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680c00/0x6ecba1490fc9d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802443.811127:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788802443.813413:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813436:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813458:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813465:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01680a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802443.813471:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813508:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813663:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff910d02e21b00) 00010000:00010000:3.0:1788802443.813667:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802443.813674:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d1f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813681:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d1f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813700:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813706:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813712:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813717:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802443.813720:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813726:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d1f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813734:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff910d02e21700) 00010000:00010000:3.0:1788802443.813737:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802443.813740:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d1f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.813758:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d1f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.815330:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d1ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf109 expref: 10 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.815361:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680c00/0x6ecba1490fc9d1ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf109 expref: 9 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.815370:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d02e21400) 00010000:00010000:3.0:1788802443.815374:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802443.815377:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01680c00, rc 0) 00000100:00100000:3.0:1788802443.815470:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+9:14428:x1875694872281984:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 6368us (6706us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788802443.815480:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:1.0:1788802443.826565:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802443.827401:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872282112 00000100:00100000:0.0:1788802443.827417:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872282112 00000100:00100000:0.0:1788802443.827553:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:0.0:1788802443.827567:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+9:14428:x1875694872282112:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788802443.827717:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+9:14428:x1875694872282112:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 Request processed in 153us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802443.827726:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:0.0:1788802443.872874:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802443.873009:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872282240 00000100:00100000:2.0:1788802443.873024:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872282240 00000100:00100000:2.0:1788802443.873103:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:2.0:1788802443.873117:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+9:14434:x1875694872282240:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802443.873148:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802443.873178:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ae00/0x6ecba1490fc9d20d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf110 expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873327:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d214 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873344:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d214 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873357:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d214 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873374:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d21b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873381:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d21b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873406:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d21b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873680:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d214 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873689:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d214 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873697:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d214 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873704:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219ac00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802443.873709:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d214 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873716:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d214 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873731:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6900) 00010000:00010000:2.0:1788802443.873734:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802443.873740:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d214 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873747:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d214 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873760:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d21b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873766:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d21b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873780:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d21b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873785:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219aa00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802443.873788:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d21b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873795:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d21b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873803:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910d157d6f00) 00010000:00010000:2.0:1788802443.873806:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802443.873809:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d21b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873815:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d21b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873857:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ae00/0x6ecba1490fc9d20d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf110 expref: 10 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873870:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6900) 00010000:00010000:2.0:1788802443.873873:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802443.873877:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ae00/0x6ecba1490fc9d20d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf110 expref: 10 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.873887:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219ae00, rc 0) 00000100:00100000:2.0:1788802443.873979:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+9:14434:x1875694872282240:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 864us (1122us total) trans 0 rc 301/301 00000100:00100000:2.0:1788802443.873997:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:1.0:1788802443.880095:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802443.880286:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872282368 00000100:00100000:3.0:1788802443.880303:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872282368 00000100:00100000:3.0:1788802443.880376:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788802443.880389:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:364c129c-855f-4ad1-8a13-12da787d546b+9:14434:x1875694872282368:12345-192.168.201.57@tcp:700:lfs.0 00000100:00100000:3.0:1788802443.880716:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:364c129c-855f-4ad1-8a13-12da787d546b+9:14434:x1875694872282368:12345-192.168.201.57@tcp:700:lfs.0 Request processed in 328us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802443.880725:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:1.0:1788802443.883723:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802443.883827:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872282624 00000100:00100000:3.0:1788802443.883841:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872282624 00000100:00100000:3.0:1788802443.883915:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788802443.883928:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+9:14434:x1875694872282624:12345-192.168.201.57@tcp:36:lfs.0 00010000:00010000:3.0:1788802443.884027:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802443.884063:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a400/0x6ecba1490fc9d150 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf08b expref: 9 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.884088:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6900) 00010000:00010000:3.0:1788802443.884094:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802443.884785:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.884806:0:14355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0ed expref: 5 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.884815:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.884862:0:14355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0ed expref: 5 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.884880:0:14355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0ed expref: 5 pid: 14353 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802443.884898:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14355:1875694892197888:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802443.885025:0:14355:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d12435780 going to sleep for 11 seconds 00000100:00100000:0.0:1788802443.889593:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802443.889729:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14355:1875694892197888:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802443.889770:0:14355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802443.889972:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872282752 00000100:00100000:1.0:1788802443.889982:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872282752 00010000:00010000:1.0:1788802443.890055:0:14338:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0ed expref: 6 pid: 14353 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802443.890114:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:1.0:1788802443.890126:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df5da259-4b74-472e-93fb-705207586f21+6:2359:x1875694872282752:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802443.890147:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802443.890155:0:14338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0ed expref: 6 pid: 14353 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802443.890171:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0ed expref: 6 pid: 14353 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802443.890226:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d188 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf0ed expref: 6 pid: 14353 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802443.890287:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6900) 00010000:00010000:1.0:1788802443.890294:0:14338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802443.890306:0:14338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802443.890314:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802443.890346:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802443.890419:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df5da259-4b74-472e-93fb-705207586f21+5:2359:x1875694872282752:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 294us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802443.890428:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00080000:2.0:1788802443.891344:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788802443.891905:0:14355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.891941:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.891980:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.891995:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.892005:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802443.893870:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788802443.893892:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.893904:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.893912:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.893919:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802443.893925:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.893935:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.893955:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6900) 00010000:00010000:0.0:1788802443.893959:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802443.893973:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.893981:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681a00/0x6ecba1490fc9d222 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788802443.894009:0:14355:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0850679 reply state 0000000037b254f9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802443.894021:0:14355:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788802443.894160:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+10:14434:x1875694872282624:12345-192.168.201.57@tcp:36:lfs.0 Request processed in 10228us (10447us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788802443.894172:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00010000:00010000:3.0:1788802443.906036:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.906077:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.906087:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.906094:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802443.906101:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.906110:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.906132:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910d02db8400) 00010000:00010000:3.0:1788802443.906137:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802443.906143:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802443.906150:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d229 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802443.916646:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802443.984079:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802443.984222:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872282880 00000100:00100000:2.0:1788802443.984271:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872282880 00000100:00100000:2.0:1788802443.984356:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:2.0:1788802443.984369:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+9:14442:x1875694872282880:12345-192.168.201.57@tcp:101:lctl.0 00010000:00010000:2.0:1788802443.984406:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802443.984438:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ae00/0x6ecba1490fc9d230 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf117 expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.984763:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d237 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.984785:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.984801:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802443.984852:0:16230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788802443.984857:0:16230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802443.984906:0:16230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.984939:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ae00/0x6ecba1490fc9d230 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf117 expref: 11 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.984965:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219aa00/0x6ecba1490fc9d237 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf117 expref: 10 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802443.985001:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6f00) 00010000:00010000:2.0:1788802443.985005:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802443.985010:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219aa00, rc 0) 00000100:00100000:2.0:1788802443.985167:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+10:14442:x1875694872282880:12345-192.168.201.57@tcp:101:lctl.0 Request processed in 801us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802443.985176:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788802444.003553:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.003676:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872283008 00000100:00100000:3.0:1788802444.003689:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872283008 00000100:00100000:3.0:1788802444.003766:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:3.0:1788802444.003779:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5da259-4b74-472e-93fb-705207586f21+5:14443:x1875694872283008:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802444.003807:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802444.003832:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d23e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf11e expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.003939:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d245 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.003952:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d245 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.003962:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d245 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802444.004001:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788802444.004005:0:14353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802444.004033:0:14353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d245 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.004061:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d23e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf11e expref: 7 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.004080:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680a00/0x6ecba1490fc9d245 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf11e expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.004086:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6f00) 00010000:00010000:3.0:1788802444.004089:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788802444.004092:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01680a00, rc 0) 00000100:00100000:3.0:1788802444.004171:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5da259-4b74-472e-93fb-705207586f21+6:14443:x1875694872283008:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 395us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802444.004179:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788802444.006734:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802444.006847:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872283136 00000100:00100000:2.0:1788802444.006862:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872283136 00000100:00100000:2.0:1788802444.006933:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:2.0:1788802444.006947:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5da259-4b74-472e-93fb-705207586f21+6:14443:x1875694872283136:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802444.006976:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802444.007003:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ae00/0x6ecba1490fc9d24c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf125 expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007087:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d253 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007105:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d253 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007119:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d253 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007138:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d25a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007146:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d25a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007178:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d25a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007344:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a000/0x6ecba1490fc9d261 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007352:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a000/0x6ecba1490fc9d261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007359:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a000/0x6ecba1490fc9d261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802444.007486:0:16230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788802444.007491:0:16230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802444.007517:0:16230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a000/0x6ecba1490fc9d261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007531:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d253 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007539:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d253 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007681:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d253 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007688:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219ac00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802444.007693:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d253 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007702:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d253 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007725:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6f00) 00010000:00010000:2.0:1788802444.007729:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802444.007735:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007742:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007757:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d25a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007764:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d25a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007770:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d25a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007776:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219ba00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802444.007779:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d25a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007785:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d25a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007793:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910d157d6a00) 00010000:00010000:2.0:1788802444.007795:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802444.007798:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d25a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007804:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d25a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007854:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ae00/0x6ecba1490fc9d24c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf125 expref: 8 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007869:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a000/0x6ecba1490fc9d261 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf125 expref: 7 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.007877:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d157d6600) 00010000:00010000:2.0:1788802444.007879:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788802444.007882:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219a000, rc 0) 00000100:00100000:2.0:1788802444.007953:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5da259-4b74-472e-93fb-705207586f21+7:14443:x1875694872283136:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1010us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802444.007962:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:1.0:1788802444.011193:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802444.011367:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872283392 00000100:00100000:0.0:1788802444.011381:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872283392 00000100:00100000:0.0:1788802444.011549:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:0.0:1788802444.011562:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5da259-4b74-472e-93fb-705207586f21+7:14443:x1875694872283392:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788802444.011589:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802444.011615:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d268 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf12c expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802444.011732:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788802444.011894:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d268 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf12c expref: 9 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.011910:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6f00) 00010000:00010000:0.0:1788802444.011931:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788802444.011939:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d268 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf12c expref: 9 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.011957:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1200, rc 0) 00000100:00100000:0.0:1788802444.012036:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df5da259-4b74-472e-93fb-705207586f21+8:14443:x1875694872283392:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 477us (858us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788802444.012048:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:0.0:1788802444.014187:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.014266:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872283648 00000100:00100000:3.0:1788802444.014290:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872283648 00000100:00100000:3.0:1788802444.014359:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:3.0:1788802444.014367:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5da259-4b74-472e-93fb-705207586f21+8:14443:x1875694872283648:12345-192.168.201.57@tcp:36:lfs.0 00010000:00010000:3.0:1788802444.014426:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802444.014467:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a000/0x6ecba1490fc9d261 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf125 expref: 8 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.014553:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d157d6600) 00010000:00010000:3.0:1788802444.014566:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802444.014594:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.014606:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.014614:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788802444.014866:0:14354:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a56d2c69 reply state 00000000ef0acae0 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802444.014877:0:14354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788802444.014887:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788802444.014969:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5da259-4b74-472e-93fb-705207586f21+9:14443:x1875694872283648:12345-192.168.201.57@tcp:36:lfs.0 Request processed in 603us (799us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788802444.014975:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:1.0:1788802444.017314:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:3.0:1788802444.017885:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.017902:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.017924:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.017931:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802444.017936:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.017946:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.017967:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d02e21700) 00010000:00010000:3.0:1788802444.017971:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788802444.017978:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.017985:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d276 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802444.018114:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872283904 00000100:00100000:0.0:1788802444.018127:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872283904 00000100:00100000:0.0:1788802444.018192:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:0.0:1788802444.018215:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df5da259-4b74-472e-93fb-705207586f21+8:14443:x1875694872283904:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:0.0:1788802444.021056:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df5da259-4b74-472e-93fb-705207586f21+9:14443:x1875694872283904:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 2837us (3740us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788802444.021072:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:1.0:1788802444.023752:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.023903:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872284160 00000100:00100000:3.0:1788802444.023915:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872284160 00000100:00100000:3.0:1788802444.023976:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:3.0:1788802444.023985:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5da259-4b74-472e-93fb-705207586f21+9:14443:x1875694872284160:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802444.024013:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802444.024037:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681400/0x6ecba1490fc9d27d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf133 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.024117:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681e00/0x6ecba1490fc9d284 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.024131:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681e00/0x6ecba1490fc9d284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.024160:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681e00/0x6ecba1490fc9d284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.024173:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681600/0x6ecba1490fc9d28b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.024178:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681600/0x6ecba1490fc9d28b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.024182:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681600/0x6ecba1490fc9d28b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802444.024892:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788802444.025016:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681e00/0x6ecba1490fc9d284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025024:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681e00/0x6ecba1490fc9d284 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025029:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681e00/0x6ecba1490fc9d284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025033:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802444.025037:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681e00/0x6ecba1490fc9d284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025043:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681e00/0x6ecba1490fc9d284 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025067:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6f00) 00010000:00010000:2.0:1788802444.025070:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802444.025074:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681e00/0x6ecba1490fc9d284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025079:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681e00/0x6ecba1490fc9d284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025091:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681600/0x6ecba1490fc9d28b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025095:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681600/0x6ecba1490fc9d28b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025098:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681600/0x6ecba1490fc9d28b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025102:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802444.025104:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681600/0x6ecba1490fc9d28b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025108:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681600/0x6ecba1490fc9d28b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025114:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910d02e21f00) 00010000:00010000:2.0:1788802444.025116:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802444.025119:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681600/0x6ecba1490fc9d28b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025124:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681600/0x6ecba1490fc9d28b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025193:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681400/0x6ecba1490fc9d27d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf133 expref: 11 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025220:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6f00) 00010000:00010000:2.0:1788802444.025223:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788802444.025227:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681400/0x6ecba1490fc9d27d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf133 expref: 11 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.025273:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01681400, rc 0) 00000100:00100000:2.0:1788802444.025779:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df5da259-4b74-472e-93fb-705207586f21+10:14443:x1875694872284160:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1791us (2034us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788802444.025789:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:2.0:1788802444.028819:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.028908:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872284288 00000100:00100000:3.0:1788802444.028922:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872284288 00000100:00100000:3.0:1788802444.029016:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:3.0:1788802444.029026:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5da259-4b74-472e-93fb-705207586f21+10:14443:x1875694872284288:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788802444.029059:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788802444.029086:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d299 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf13a expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.029211:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.029225:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.029295:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788802444.029329:0:16230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788802444.029349:0:16230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788802444.029385:0:16230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.029418:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d299 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf13a expref: 12 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.029437:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf13a expref: 11 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.029444:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d02e21100) 00010000:00010000:3.0:1788802444.029446:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788802444.029449:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d01680200, rc 0) 00000100:00100000:3.0:1788802444.029529:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df5da259-4b74-472e-93fb-705207586f21+11:14443:x1875694872284288:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 506us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802444.029535:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:1.0:1788802444.032736:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802444.032881:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872284416 00000100:00100000:0.0:1788802444.032897:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872284416 00000100:00100000:0.0:1788802444.033007:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:0.0:1788802444.033021:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df5da259-4b74-472e-93fb-705207586f21+11:14443:x1875694872284416:12345-192.168.201.57@tcp:37:lfs.0 00000100:00100000:0.0:1788802444.038263:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df5da259-4b74-472e-93fb-705207586f21+11:14443:x1875694872284416:12345-192.168.201.57@tcp:37:lfs.0 Request processed in 5202us (5501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802444.038289:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:2.0:1788802444.042789:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.042902:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872284672 00000100:00100000:3.0:1788802444.042924:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872284672 00000100:00100000:3.0:1788802444.043015:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:3.0:1788802444.043025:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d08c12c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df5da259-4b74-472e-93fb-705207586f21+11:14443:x1875694872284672:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802444.043357:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d08c12c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df5da259-4b74-472e-93fb-705207586f21+12:14443:x1875694872284672:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 332us (578us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788802444.043366:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:1.0:1788802444.114173:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802444.114492:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872284800 00000100:00100000:0.0:1788802444.114515:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872284800 00000100:00100000:0.0:1788802444.114597:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:0.0:1788802444.114610:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+10:14449:x1875694872284800:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802444.114658:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802444.114683:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d2a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf141 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.114757:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d2ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.114772:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d2ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.114783:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d2ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.114794:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.114799:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.114803:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.114895:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d2bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.114900:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d2bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.114905:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d2bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802444.114936:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788802444.114946:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802444.114999:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d2bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115014:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d2ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115019:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d2ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115024:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d2ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115028:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802444.115031:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d2ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115037:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d2ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115047:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6f00) 00010000:00010000:0.0:1788802444.115050:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802444.115055:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d2ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115058:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d2ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115070:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115074:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115085:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115089:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802444.115091:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115094:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115098:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff910d02db8d00) 00010000:00010000:0.0:1788802444.115099:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802444.115101:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115104:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115131:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d2a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf141 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115140:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0c00/0x6ecba1490fc9d2bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf141 expref: 11 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.115146:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d02e21100) 00010000:00010000:0.0:1788802444.115147:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788802444.115149:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0c00, rc 0) 00000100:00100000:0.0:1788802444.115314:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+11:14449:x1875694872284800:12345-192.168.201.57@tcp:101:bash.0 Request processed in 628us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802444.115331:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:1.0:1788802444.120594:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802444.120709:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872285056 00000100:00100000:2.0:1788802444.120724:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872285056 00000100:00100000:2.0:1788802444.120800:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:2.0:1788802444.120814:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+11:14449:x1875694872285056:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788802444.120845:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802444.120872:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d2c3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf148 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.121030:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.121047:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf13a expref: 11 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.121075:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.121120:0:14354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf13a expref: 11 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.121137:0:14354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf13a expref: 11 pid: 16230 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802444.121152:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04542d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14354:1875694892198016:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802444.121323:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d10b57480 going to sleep for 11 seconds 00000100:00100000:2.0:1788802444.129862:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04542d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14354:1875694892198016:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802444.129905:0:14354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802444.136015:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.136134:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872285184 00000100:00100000:3.0:1788802444.136148:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872285184 00010000:00010000:3.0:1788802444.136215:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf13a expref: 12 pid: 16230 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802444.136686:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788802444.136704:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df5da259-4b74-472e-93fb-705207586f21+12:2359:x1875694872285184:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802444.136723:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802444.136732:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf13a expref: 12 pid: 16230 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.136748:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf13a expref: 12 pid: 16230 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.136776:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01680200/0x6ecba1490fc9d2a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf13a expref: 12 pid: 16230 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.136807:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d02e21100) 00010000:00010000:2.0:1788802444.136814:0:14339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.136825:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.136835:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.136877:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802444.136956:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df5da259-4b74-472e-93fb-705207586f21+11:2359:x1875694872285184:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 258us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802444.136964:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00010000:00010000:3.0:1788802444.137123:0:14354:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.137134:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.137162:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.137174:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.137183:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.140999:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.141026:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.141040:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802444.141056:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788802444.141093:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.141102:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.141131:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.141137:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219b800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802444.141142:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.141151:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.141166:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d02e21100) 00010000:00010000:2.0:1788802444.141170:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802444.141175:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.141182:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d2ca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802444.141216:0:14354:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d861f306 reply state 000000002ee17258 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802444.141227:0:14354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788802444.141352:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d2c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf148 expref: 14 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.141371:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf148 expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.141380:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:2.0:1788802444.141389:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788802444.141392:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219b200, rc 0) 00000100:00100000:2.0:1788802444.141500:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+14:14449:x1875694872285056:12345-192.168.201.57@tcp:101:bash.0 Request processed in 20688us (20921us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788802444.141510:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 28 00010000:00010000:3.0:1788802444.148774:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.148798:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.148807:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.148815:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802444.148820:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.148829:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.148874:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff910d02e21700) 00010000:00010000:3.0:1788802444.148877:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802444.148884:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802444.148891:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d2d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802444.160205:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802444.160890:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872285312 00000100:00100000:0.0:1788802444.160906:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872285312 00000100:00100000:0.0:1788802444.161041:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:0.0:1788802444.161054:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+13:14449:x1875694872285312:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802444.161091:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802444.161122:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d2e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf14f expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.161231:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.161282:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.161299:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802444.161351:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788802444.161356:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802444.161380:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.161391:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.161422:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d2e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf14f expref: 15 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.161883:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf14f expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.161914:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:0.0:1788802444.161917:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802444.161922:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0000, rc 0) 00000100:00100000:0.0:1788802444.162017:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+14:14449:x1875694872285312:12345-192.168.201.57@tcp:101:bash.0 Request processed in 965us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802444.162025:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:1.0:1788802444.167172:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802444.167315:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872285568 00000100:00100000:0.0:1788802444.167330:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872285568 00000100:00100000:0.0:1788802444.167404:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:0.0:1788802444.167417:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+14:14449:x1875694872285568:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:0.0:1788802444.167909:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+15:14449:x1875694872285568:12345-192.168.201.57@tcp:35:bash.0 Request processed in 492us (750us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788802444.167917:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000040:00080000:3.0:1788802444.238210:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788802444.279213:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.279314:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.279347:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.279392:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.279420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.279466:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872285824 00000100:00100000:3.0:1788802444.279487:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872285824 00000100:00100000:3.0:1788802444.279815:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872286080 00000100:00100000:3.0:1788802444.279820:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872286080 00000100:00100000:3.0:1788802444.279842:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872285952 00000100:00100000:3.0:1788802444.279846:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872285952 00000100:00100000:3.0:1788802444.279857:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872286208 00000100:00100000:3.0:1788802444.279859:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872286208 00000100:00100000:3.0:1788802444.279878:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:3.0:1788802444.279892:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2360:x1875694872285824:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802444.279996:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2360:x1875694872285824:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 108us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802444.280005:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:3.0:1788802444.280026:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788802444.280053:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df5da259-4b74-472e-93fb-705207586f21+5:2360:x1875694872286080:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802444.280083:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df5da259-4b74-472e-93fb-705207586f21+5:2360:x1875694872286080:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 31us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802444.280088:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788802444.280100:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:3.0:1788802444.280105:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2360:x1875694872285952:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802444.280127:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2360:x1875694872285952:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 22us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802444.280133:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:3.0:1788802444.280148:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:3.0:1788802444.280154:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df5da259-4b74-472e-93fb-705207586f21+5:2360:x1875694872286208:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788802444.280177:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df5da259-4b74-472e-93fb-705207586f21+5:2360:x1875694872286208:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 24us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802444.280182:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00080000:3.0:1788802444.280205:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788802444.280210:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802444.281080:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872285696 00000100:00100000:2.0:1788802444.281092:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872285696 00000100:00100000:2.0:1788802444.281148:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:2.0:1788802444.281157:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d35889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:2360:x1875694872285696:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788802444.281218:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d35889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:2360:x1875694872285696:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 63us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802444.281225:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 120 00000100:00100000:3.0:1788802444.303918:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802444.304110:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872286464 00000100:00100000:2.0:1788802444.304126:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872286464 00000100:00100000:2.0:1788802444.304215:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:2.0:1788802444.304227:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+15:14459:x1875694872286464:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802444.304299:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802444.304329:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d2f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf156 expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802444.304789:0:16230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788802444.304967:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d2f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf156 expref: 17 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.304984:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6f00) 00010000:00010000:2.0:1788802444.304988:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788802444.304994:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d2f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf156 expref: 17 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.305026:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219ac00, rc 0) 00000100:00100000:2.0:1788802444.305121:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+16:14459:x1875694872286464:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 896us (1217us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788802444.305131:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:1.0:1788802444.308187:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802444.308858:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872286720 00000100:00100000:2.0:1788802444.308873:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872286720 00000100:00100000:2.0:1788802444.308951:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788802444.308964:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+16:14459:x1875694872286720:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788802444.310342:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+17:14459:x1875694872286720:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 1369us (2157us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788802444.310364:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:1.0:1788802444.381369:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802444.381918:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872286976 00000100:00100000:2.0:1788802444.381933:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872286976 00000100:00100000:2.0:1788802444.382009:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:2.0:1788802444.382023:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+17:14462:x1875694872286976:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802444.382057:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802444.382084:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d302 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf15d expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.382752:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d309 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.382774:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d309 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.382789:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d309 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802444.382821:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788802444.383009:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d302 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf15d expref: 20 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.383034:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d309 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf15d expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.383045:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:2.0:1788802444.383048:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802444.383052:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219b800, rc 0) 00000100:00100000:2.0:1788802444.383152:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+19:14462:x1875694872286976:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1132us (1798us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788802444.383167:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:3.0:1788802444.390327:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.394517:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802444.396035:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872287104 00000100:00100000:1.0:1788802444.396053:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872287104 00000100:00100000:1.0:1788802444.396149:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:1.0:1788802444.396163:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:364c129c-855f-4ad1-8a13-12da787d546b+19:2360:x1875694872287104:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802444.396184:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802444.396231:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d309 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf15d expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802444.397795:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:1.0:1788802444.397803:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802444.397905:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:364c129c-855f-4ad1-8a13-12da787d546b+18:2360:x1875694872287104:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 1741us (7589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802444.397916:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:0.0:1788802444.399904:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872287232 00000100:00100000:0.0:1788802444.399925:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872287232 00000100:00100000:0.0:1788802444.399998:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:0.0:1788802444.400010:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+18:14462:x1875694872287232:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:0.0:1788802444.400102:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d317 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.400123:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.400138:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.400446:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.400456:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d317 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.400463:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d317 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.400666:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802444.400671:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d317 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.400681:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d317 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.400696:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:0.0:1788802444.400699:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788802444.400705:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d317 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.400712:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d317 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802444.400867:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+18:14462:x1875694872287232:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 856us (6361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802444.400876:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:1.0:1788802444.408980:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802444.409146:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872287488 00000100:00100000:3.0:1788802444.409161:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872287488 00000100:00100000:2.0:1788802444.409449:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:2.0:1788802444.409477:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+18:14462:x1875694872287488:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788802444.409827:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+19:14462:x1875694872287488:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 365us (862us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788802444.409836:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788802444.884153:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802444.884626:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872287744 00000100:00100000:0.0:1788802444.884642:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872287744 00000100:00100000:0.0:1788802444.884734:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:0.0:1788802444.884764:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+19:14493:x1875694872287744:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:0.0:1788802444.884901:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802444.884942:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d31e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf164 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.885077:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d325 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.885094:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d325 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.885107:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d325 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802444.885121:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788802444.886796:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d31e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf164 expref: 22 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.886832:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d325 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf164 expref: 21 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802444.886843:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:0.0:1788802444.886846:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788802444.886851:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1800, rc 0) 00000100:00100000:0.0:1788802444.887299:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+21:14493:x1875694872287744:12345-192.168.201.57@tcp:101:cat.0 Request processed in 2477us (3102us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788802444.887309:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:0.0:1788802444.899206:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802444.901878:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872287872 00000100:00100000:2.0:1788802444.901905:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872287872 00000100:00100000:2.0:1788802444.902012:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:2.0:1788802444.902037:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:364c129c-855f-4ad1-8a13-12da787d546b+21:2359:x1875694872287872:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802444.902065:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802444.902099:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d325 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf164 expref: 21 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802444.902149:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:2.0:1788802444.902156:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802444.902446:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:364c129c-855f-4ad1-8a13-12da787d546b+20:2359:x1875694872287872:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 422us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802444.902456:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:3.0:1788802444.903455:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802444.904791:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872288128 00000100:00100000:2.0:1788802444.904808:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872288128 00000100:00100000:2.0:1788802444.904882:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788802444.904893:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+20:14493:x1875694872288128:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:2.0:1788802444.905427:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+21:14493:x1875694872288128:12345-192.168.201.57@tcp:35:cat.0 Request processed in 531us (1978us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788802444.905436:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00010000:00010000:2.0:1788802444.942821:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802445.026843:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802445.027423:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872288384 00000100:00100000:2.0:1788802445.027438:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872288384 00000100:00100000:2.0:1788802445.027533:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:2.0:1788802445.027547:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+21:14499:x1875694872288384:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:2.0:1788802445.027581:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802445.027610:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d333 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf16b expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.027749:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b000/0x6ecba1490fc9d33a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.027770:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b000/0x6ecba1490fc9d33a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.027806:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b000/0x6ecba1490fc9d33a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802445.027824:0:16230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788802445.028040:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d333 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf16b expref: 24 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.028064:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b000/0x6ecba1490fc9d33a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf16b expref: 23 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.028074:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:2.0:1788802445.028077:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802445.028081:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219b000, rc 0) 00000100:00080000:3.0:1788802445.028281:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802445.028638:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+23:14499:x1875694872288384:12345-192.168.201.57@tcp:101:dd.0 Request processed in 1092us (1809us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788802445.028647:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:1.0:1788802445.044883:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802445.044995:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872288640 00000100:00100000:2.0:1788802445.045009:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872288640 00000100:00100000:2.0:1788802445.045105:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:2.0:1788802445.045118:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+23:14499:x1875694872288640:12345-192.168.201.57@tcp:36:dd.0 00010000:00010000:2.0:1788802445.045202:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788802445.045290:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b000/0x6ecba1490fc9d33a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf16b expref: 23 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.045318:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d2ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf14f expref: 22 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.045356:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:2.0:1788802445.045362:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788802445.045630:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.045648:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.045660:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788802445.045718:0:14353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788802445.045747:0:14353:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f3eeedc reply state 00000000d4c438b5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802445.045759:0:14353:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788802445.045881:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+24:14499:x1875694872288640:12345-192.168.201.57@tcp:36:dd.0 Request processed in 765us (1015us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788802445.045889:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000020:00080000:2.0:1788802445.045895:0:14353:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788802445.058351:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802445.058376:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802445.058385:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802445.058392:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219ac00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802445.058398:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802445.058406:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802445.058430:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:3.0:1788802445.058434:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802445.058438:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802445.058461:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d348 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802445.244751:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802445.249766:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872288896 00000100:00100000:2.0:1788802445.249789:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872288896 00000100:00100000:2.0:1788802445.249888:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:2.0:1788802445.249902:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+23:14499:x1875694872288896:12345-192.168.201.57@tcp:35:dd.0 00000100:00100000:2.0:1788802445.250321:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+24:14499:x1875694872288896:12345-192.168.201.57@tcp:35:dd.0 Request processed in 420us (5583us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788802445.250329:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:1.0:1788802445.641846:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802445.642193:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872289024 00000100:00100000:2.0:1788802445.642228:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872289024 00000100:00100000:2.0:1788802445.642420:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:2.0:1788802445.642445:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+24:14513:x1875694872289024:12345-192.168.201.57@tcp:101:stat.0 00010000:00010000:2.0:1788802445.642480:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802445.642509:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b000/0x6ecba1490fc9d34f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf172 expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642601:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d356 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642621:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d356 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642637:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d356 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642655:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a200/0x6ecba1490fc9d35d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642663:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a200/0x6ecba1490fc9d35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642670:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a200/0x6ecba1490fc9d35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642785:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b400/0x6ecba1490fc9d364 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642794:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b400/0x6ecba1490fc9d364 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642801:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b400/0x6ecba1490fc9d364 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802445.642859:0:16230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788802445.642864:0:16230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788802445.642912:0:16230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b400/0x6ecba1490fc9d364 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642926:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b400/0x6ecba1490fc9d364 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642934:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d356 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642940:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d356 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642947:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d356 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642954:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219b600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802445.642959:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d356 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642967:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d356 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642982:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d02e21100) 00010000:00010000:2.0:1788802445.642986:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802445.642992:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d356 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.642999:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d356 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.643129:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a200/0x6ecba1490fc9d35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.643137:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a200/0x6ecba1490fc9d35d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.643143:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a200/0x6ecba1490fc9d35d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.643149:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219a200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802445.643152:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a200/0x6ecba1490fc9d35d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.643159:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a200/0x6ecba1490fc9d35d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.643171:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff910d157d6c00) 00010000:00010000:2.0:1788802445.643174:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802445.643178:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a200/0x6ecba1490fc9d35d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.643185:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a200/0x6ecba1490fc9d35d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.643232:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b000/0x6ecba1490fc9d34f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf172 expref: 26 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.643319:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b400/0x6ecba1490fc9d364 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf172 expref: 25 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802445.643340:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:2.0:1788802445.643342:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802445.643345:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219b400, rc 0) 00000100:00100000:2.0:1788802445.643440:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+25:14513:x1875694872289024:12345-192.168.201.57@tcp:101:stat.0 Request processed in 998us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802445.643449:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:3.0:1788802445.730457:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802445.730512:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872289280 00000100:00100000:3.0:1788802445.730525:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872289280 00000100:00100000:3.0:1788802445.730593:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:3.0:1788802445.730607:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+25:14519:x1875694872289280:12345-192.168.201.57@tcp:36:truncate.0 00010000:00010000:3.0:1788802445.730688:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802445.730727:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b400/0x6ecba1490fc9d364 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf172 expref: 25 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802445.730760:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:3.0:1788802445.730768:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788802445.731681:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802445.731704:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802445.731717:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788802445.731797:0:14353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788802445.731832:0:14353:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037234ff0 reply state 00000000ad265cd8 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802445.731843:0:14353:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788802445.732005:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+27:14519:x1875694872289280:12345-192.168.201.57@tcp:36:truncate.0 Request processed in 1397us (1567us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788802445.732015:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00000020:00080000:3.0:1788802445.732022:0:14353:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788802445.741922:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802445.741970:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802445.741981:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802445.741989:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802445.741995:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802445.742005:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802445.742028:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:0.0:1788802445.742031:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802445.742038:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802445.742045:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d36b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802445.898133:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:0.0:1788802445.898157:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1788802445.898168:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:0.0:1788802445.898190:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1788802445.898199:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1788802445.967117:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802445.982851:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802445.984006:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872289408 00000100:00100000:1.0:1788802445.984024:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872289408 00000100:00100000:1.0:1788802445.984272:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:1.0:1788802445.984395:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+12:14533:x1875694872289408:12345-192.168.201.57@tcp:101:stat.0 00010000:00010000:1.0:1788802445.984428:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802445.984627:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3a00/0x6ecba1490fc9d372 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf179 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.984962:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d379 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.985002:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d379 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.985015:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d379 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.985032:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d380 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.985038:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.985043:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.986101:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.986118:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.986128:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802445.986428:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788802445.986435:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802445.986942:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.986961:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.986987:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d379 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.986993:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d379 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987002:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d379 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987008:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3c00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802445.987013:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d379 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987022:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d379 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987037:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d02e21100) 00010000:00010000:1.0:1788802445.987040:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802445.987046:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d379 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987053:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d379 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987069:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987075:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987081:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987092:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f3e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:1.0:1788802445.987095:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987100:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d380 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987108:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff910d05184300) 00010000:00010000:1.0:1788802445.987110:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788802445.987113:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d380 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987118:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d380 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987383:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3a00/0x6ecba1490fc9d372 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf179 expref: 14 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987402:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf179 expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802445.987410:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:1.0:1788802445.987412:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802445.987415:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2600, rc 0) 00000100:00100000:1.0:1788802445.987724:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+13:14533:x1875694872289408:12345-192.168.201.57@tcp:101:stat.0 Request processed in 3333us (4888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802445.987733:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:3.0:1788802446.137754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802446.137899:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872289664 00000100:00100000:2.0:1788802446.137915:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872289664 00000100:00100000:2.0:1788802446.137999:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:2.0:1788802446.138013:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+13:14543:x1875694872289664:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788802446.138048:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802446.138077:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d38e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf180 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802446.138216:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788802446.138597:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d38e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf180 expref: 15 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.138645:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6f00) 00010000:00010000:0.0:1788802446.138650:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788802446.138657:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d38e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf180 expref: 15 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.138675:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219b600, rc 0) 00000100:00100000:0.0:1788802446.138774:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+14:14543:x1875694872289664:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 764us (1036us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1788802446.138782:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:2.0:1788802446.145919:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.146071:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872289920 00000100:00100000:3.0:1788802446.146084:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872289920 00000100:00100000:3.0:1788802446.146150:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788802446.146160:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10c35050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:364c129c-855f-4ad1-8a13-12da787d546b+14:14543:x1875694872289920:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802446.146870:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10c35050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:364c129c-855f-4ad1-8a13-12da787d546b+15:14543:x1875694872289920:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 703us (962us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788802446.146904:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788802446.193760:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802446.193888:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872290176 00000100:00100000:2.0:1788802446.193904:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872290176 00000100:00100000:2.0:1788802446.193990:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:2.0:1788802446.194003:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+15:14549:x1875694872290176:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788802446.194040:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802446.194072:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219be00/0x6ecba1490fc9d39c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf187 expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.194399:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.194695:0:16230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf148 expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.194706:0:16230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf179 expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.194716:0:16230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.194765:0:16230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf179 expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.194784:0:16230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf179 expref: 16 pid: 14354 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802446.194804:0:16230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04542d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16230:1875694892198144:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788802446.195090:0:16230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf148 expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.195100:0:16230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf148 expref: 16 pid: 14354 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802446.195109:0:16230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04542300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16230:1875694892198272:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788802446.195137:0:16230:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d10fd0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802446.201958:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802446.202078:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.203332:0:16230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04542d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16230:1875694892198144:192.168.201.57@tcp:104: 00000100:00100000:3.0:1788802446.203353:0:16230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04542300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16230:1875694892198272:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802446.203388:0:16230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802446.206532:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872290432 00000100:00100000:1.0:1788802446.206583:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872290432 00010000:00010000:1.0:1788802446.206655:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf148 expref: 17 pid: 14354 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802446.206717:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872290304 00000100:00100000:1.0:1788802446.206721:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872290304 00010000:00010000:1.0:1788802446.206735:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf179 expref: 18 pid: 14354 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802446.206753:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:1.0:1788802446.206763:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3f3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:364c129c-855f-4ad1-8a13-12da787d546b+18:2357:x1875694872290432:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802446.206784:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802446.206792:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf148 expref: 18 pid: 14354 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.206808:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf148 expref: 18 pid: 14354 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.206841:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b200/0x6ecba1490fc9d2d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf148 expref: 18 pid: 14354 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.206863:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:1.0:1788802446.206869:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.206879:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.206887:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802446.206997:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3f3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:364c129c-855f-4ad1-8a13-12da787d546b+17:2357:x1875694872290432:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 234us (5053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.207006:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:1.0:1788802446.207067:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:1.0:1788802446.207074:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:364c129c-855f-4ad1-8a13-12da787d546b+16:2357:x1875694872290304:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788802446.207081:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802446.207086:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf179 expref: 16 pid: 14354 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.207096:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf179 expref: 16 pid: 14354 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.207109:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d387 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf179 expref: 16 pid: 14354 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.207119:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:1.0:1788802446.207123:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.207132:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.207141:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.207196:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788802446.207217:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:364c129c-855f-4ad1-8a13-12da787d546b+15:2357:x1875694872290304:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 143us (5140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.207223:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00010000:00010000:2.0:1788802446.207489:0:16230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.207499:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788802446.207523:0:16230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788802446.207725:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219be00/0x6ecba1490fc9d39c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf187 expref: 16 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.207742:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf187 expref: 15 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.207750:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:2.0:1788802446.207753:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788802446.207756:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219b600, rc 0) 00000100:00100000:2.0:1788802446.207805:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+15:14549:x1875694872290176:12345-192.168.201.57@tcp:101:bash.0 Request processed in 13805us (14075us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1788802446.207813:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:2.0:1788802446.216543:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.216742:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872290688 00000100:00100000:3.0:1788802446.216757:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872290688 00000100:00100000:3.0:1788802446.216827:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:3.0:1788802446.216840:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+15:14549:x1875694872290688:12345-192.168.201.57@tcp:36:bash.0 00010000:00010000:3.0:1788802446.217198:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.217219:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.217230:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788802446.217676:0:14355:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788802446.217716:0:14355:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f651353c reply state 00000000d3a9a545 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802446.217727:0:14355:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788802446.217863:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+18:14549:x1875694872290688:12345-192.168.201.57@tcp:36:bash.0 Request processed in 1022us (1332us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788802446.217871:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00000020:00080000:2.0:1788802446.217878:0:14355:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788802446.222072:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788802446.222107:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d04540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892198400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788802446.222204:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788802446.222324:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892198400 00000100:00100000:2.0:1788802446.222334:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892198400 00000100:00100000:2.0:1788802446.222408:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788802446.222420:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892198400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788802446.222477:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788802446.222536:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875694892198400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802446.222544:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788802446.222615:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788802446.222663:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d04540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875694892198400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788802446.224280:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788802446.224305:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892198528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788802446.224380:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802446.224619:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892198528 00000100:00100000:0.0:1788802446.224630:0:15042:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892198528 00000100:00100000:0.0:1788802446.224699:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788802446.224710:0:15042:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892198528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788802446.224753:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788802446.224801:0:15042:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875694892198528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802446.224809:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788802446.224839:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788802446.224877:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875694892198528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788802446.225056:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892198784:0@lo:400:kworker.0 00000100:00100000:1.0:1788802446.225099:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802446.225124:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788802446.225130:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87cc913b-814f-413d-b622-408baef57c45:3312:1875694892198656:0@lo:400:kworker.0 00000100:00100000:1.0:1788802446.225159:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788802446.225200:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892198656 00000100:00100000:1.0:1788802446.225204:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892198656 00000100:00100000:1.0:1788802446.225285:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788802446.225294:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d35888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:3312:x1875694892198656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802446.225333:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d35888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:87cc913b-814f-413d-b622-408baef57c45+19:3312:x1875694892198656:12345-0@lo:400:kworker.0 Request processed in 40us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.225340:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788802446.225381:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:87cc913b-814f-413d-b622-408baef57c45:3312:1875694892198656:0@lo:400:kworker.0 00000100:00100000:1.0:1788802446.225404:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892198784 00000100:00100000:1.0:1788802446.225407:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892198784 00000100:00100000:1.0:1788802446.225631:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788802446.225639:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892198784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802446.225681:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875694892198784:12345-0@lo:400:kworker.0 Request processed in 44us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.225688:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788802446.225718:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875694892198784:0@lo:400:kworker.0 00000100:00100000:3.0:1788802446.226205:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892199040:0@lo:400:kworker.0 00000100:00100000:0.0:1788802446.228190:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892198912:0@lo:400:kworker.0 00000100:00100000:0.0:1788802446.228316:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802446.228740:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892198912 00000100:00100000:3.0:1788802446.228751:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892198912 00000100:00080000:0.0:1788802446.228873:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788802446.228916:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788802446.228928:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892198912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788802446.229007:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875694892198912:12345-0@lo:400:kworker.0 Request processed in 80us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802446.229022:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788802446.229106:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875694892198912:0@lo:400:kworker.0 00000100:00100000:2.0:1788802446.229959:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802446.233737:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00010000:00010000:2.0:1788802446.233800:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.233816:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.233825:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.233831:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802446.233837:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.233847:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.233896:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:2.0:1788802446.233899:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802446.233906:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.233912:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681000/0x6ecba1490fc9d3b1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802446.234731:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892199040 00000100:00100000:1.0:1788802446.234749:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892199040 00000100:00100000:1.0:1788802446.234898:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788802446.234910:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892199040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788802446.235023:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875694892199040:12345-0@lo:400:kworker.0 Request processed in 115us (5068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.235044:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788802446.235074:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788802446.235128:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875694892199040:0@lo:400:kworker.0 00000100:00100000:1.0:1788802446.235791:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872290816 00000100:00100000:1.0:1788802446.235799:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872290816 00000100:00100000:1.0:1788802446.235874:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:1.0:1788802446.235883:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+17:14549:x1875694872290816:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788802446.235905:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802446.235929:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d3b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf18e expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.236005:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d3b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf18e expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.236020:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d3b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf18e expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.236041:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:1.0:1788802446.236044:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788802446.236048:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f2600, rc 0) 00000100:00100000:1.0:1788802446.236152:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+18:14549:x1875694872290816:12345-192.168.201.57@tcp:101:bash.0 Request processed in 270us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.236158:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:3.0:1788802446.241984:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802446.242595:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872290944 00000100:00100000:1.0:1788802446.242609:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872290944 00000100:00100000:1.0:1788802446.242678:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:1.0:1788802446.242689:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+18:14549:x1875694872290944:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788802446.242732:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802446.242758:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d3bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf195 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.242860:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.242877:0:14353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf187 expref: 19 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.242887:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.242928:0:14353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf187 expref: 19 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.242942:0:14353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf187 expref: 19 pid: 16230 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802446.242958:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14353:1875694892199168:192.168.201.57@tcp:104: 00000100:00100000:1.0:1788802446.243051:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d1d1abb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788802446.248007:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.248725:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872291072 00000100:00100000:0.0:1788802446.248739:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872291072 00010000:00010000:0.0:1788802446.248800:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf187 expref: 20 pid: 16230 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.248856:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:0.0:1788802446.248869:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:364c129c-855f-4ad1-8a13-12da787d546b+20:2359:x1875694872291072:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788802446.248889:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802446.248898:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf187 expref: 20 pid: 16230 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.248914:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf187 expref: 20 pid: 16230 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.248942:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:0.0:1788802446.248948:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.248961:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.248970:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.248994:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788802446.249054:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:364c129c-855f-4ad1-8a13-12da787d546b+20:2359:x1875694872291072:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 188us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802446.249076:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00010000:00010000:1.0:1788802446.250013:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b600/0x6ecba1490fc9d3a3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf187 expref: 19 pid: 16230 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802446.250036:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a18e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14353:1875694892199168:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788802446.250066:0:14353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.250089:0:14353:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.250096:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802446.250157:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788802446.250174:0:14353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788802446.250204:0:14353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.250417:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d3bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf195 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.250447:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf195 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.250457:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:1.0:1788802446.250460:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788802446.250463:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3c00, rc 0) 00000100:00100000:1.0:1788802446.250522:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+18:14549:x1875694872290944:12345-192.168.201.57@tcp:101:bash.0 Request processed in 7835us (8555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.250530:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:2.0:1788802446.253314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.253665:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872291328 00000100:00100000:3.0:1788802446.253679:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872291328 00000100:00100000:3.0:1788802446.253797:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:3.0:1788802446.253812:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:364c129c-855f-4ad1-8a13-12da787d546b+18:14549:x1875694872291328:12345-192.168.201.57@tcp:103:bash.0 00010000:00010000:3.0:1788802446.253832:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788802446.253865:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3c00/0x6ecba1490fc9d3c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf195 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.253894:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2600/0x6ecba1490fc9d3b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf18e expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.253905:0:14339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d157d6a00) 00010000:00010000:3.0:1788802446.253918:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802446.253999:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:364c129c-855f-4ad1-8a13-12da787d546b+16:14549:x1875694872291328:12345-192.168.201.57@tcp:103:bash.0 Request processed in 190us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802446.254008:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:2.0:1788802446.256829:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802446.256927:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872291456 00000100:00100000:1.0:1788802446.256941:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872291456 00000100:00100000:1.0:1788802446.257052:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:1.0:1788802446.257065:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+16:14549:x1875694872291456:12345-192.168.201.57@tcp:58:bash.0 00010000:00010000:1.0:1788802446.257213:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.257613:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.257628:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788802446.258867:0:16230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788802446.259050:0:16230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788802446.259126:0:16230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788802446.260077:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+16:14549:x1875694872291456:12345-192.168.201.57@tcp:58:bash.0 Request processed in 3000us (3249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802446.260094:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:2.0:1788802446.263003:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.263116:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872291584 00000100:00100000:0.0:1788802446.263130:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872291584 00000100:00100000:0.0:1788802446.263463:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:0.0:1788802446.263477:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+16:14549:x1875694872291584:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802446.263504:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802446.263534:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9d3d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf19c expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.263616:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.263627:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9d3d4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf19c expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.263650:0:14354:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.263667:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9d3d4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf19c expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.263684:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d05184300) 00010000:00010000:0.0:1788802446.263688:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788802446.263692:0:14354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9d3d4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf19c expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.263720:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1400, rc 0) 00000100:00100000:0.0:1788802446.263814:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+17:14549:x1875694872291584:12345-192.168.201.57@tcp:101:bash.0 Request processed in 339us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802446.263822:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000040:00080000:3.0:1788802446.286092:0:14387:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788802446.286105:0:14387:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802446.286157:0:14387:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788802446.286166:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788802446.286388:0:14387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d41e6f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14387:1875694892199296:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788802446.286671:0:14387:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d08206300 going to sleep for 11 seconds 00000100:00100000:2.0:1788802446.292772:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.292999:0:14387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d41e6f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14387:1875694892199296:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788802446.293574:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872291712 00000100:00100000:0.0:1788802446.293586:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872291712 00000100:00100000:0.0:1788802446.293659:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:0.0:1788802446.293670:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d04543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:364c129c-855f-4ad1-8a13-12da787d546b+17:14550:x1875694872291712:12345-192.168.201.57@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788802446.293788:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d04543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:364c129c-855f-4ad1-8a13-12da787d546b+17:14550:x1875694872291712:12345-192.168.201.57@tcp:900:lhsmtool_posix.0 Request processed in 120us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802446.293797:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:0.0:1788802446.297740:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.298110:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872291840 00000100:00100000:3.0:1788802446.298143:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872291840 00000100:00100000:2.0:1788802446.302718:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:2.0:1788802446.302747:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+17:14550:x1875694872291840:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788802446.302802:0:14355:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788802446.303020:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+17:14550:x1875694872291840:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 283us (5292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802446.303028:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:1.0:1788802446.312696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.312809:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872291968 00000100:00100000:0.0:1788802446.312823:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872291968 00000100:00100000:0.0:1788802446.313138:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:0.0:1788802446.313154:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+17:14550:x1875694872291968:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788802446.313478:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d3db lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313499:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d3db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313514:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d3db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313531:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d3e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313558:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313565:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313595:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313605:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313611:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802446.313667:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788802446.313672:0:14353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802446.313691:0:14353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313704:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d3db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313711:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d3db lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313719:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d3db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313725:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802446.313731:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d3db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313746:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d3db lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313761:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d02e21400) 00010000:00010000:0.0:1788802446.313765:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802446.313772:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d3db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313778:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d3db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313793:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313799:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d3e2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313805:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313811:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802446.313813:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313819:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d3e2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313827:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff910d02db8c00) 00010000:00010000:0.0:1788802446.313829:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802446.313832:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d3e2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313848:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d3e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313866:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313872:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313877:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313882:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802446.313885:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313891:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313899:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d05184300) 00010000:00010000:0.0:1788802446.313901:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802446.313904:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.313910:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d3e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.314035:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+17:14550:x1875694872291968:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 883us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802446.314044:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:1.0:1788802446.319215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.320431:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872292224 00000100:00100000:0.0:1788802446.320450:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872292224 00000100:00100000:0.0:1788802446.320582:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:0.0:1788802446.320597:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+17:14550:x1875694872292224:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802446.320631:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802446.320661:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d3f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf1a3 expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.320805:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d3f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.320827:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.320842:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802446.320856:0:16230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788802446.321000:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.321010:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.321018:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.321025:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802446.321031:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.321040:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.321076:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d05184300) 00010000:00010000:0.0:1788802446.321079:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788802446.321085:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d3f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.321092:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d3f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.321150:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d3f0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1a3 expref: 19 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.321162:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff910d02e21400) 00010000:00010000:0.0:1788802446.321165:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788802446.321169:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0a00/0x6ecba1490fc9d3f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1a3 expref: 19 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.321180:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0a00, rc 0) 00000100:00100000:0.0:1788802446.321317:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+18:14550:x1875694872292224:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 723us (2178us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1788802446.321325:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:2.0:1788802446.328656:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802446.328799:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872292352 00000100:00100000:1.0:1788802446.328818:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872292352 00000100:00100000:1.0:1788802446.328906:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:1.0:1788802446.328920:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+18:14550:x1875694872292352:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788802446.329603:0:14354:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788802446.329815:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+18:14550:x1875694872292352:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 894us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.329824:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:1.0:1788802446.334167:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802446.334844:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872292608 00000100:00100000:2.0:1788802446.334862:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872292608 00000100:00100000:2.0:1788802446.334950:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:2.0:1788802446.334963:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+18:14550:x1875694872292608:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802446.334994:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802446.335024:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d405 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf1aa expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788802446.337059:0:14355:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1788802446.337073:0:14355:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788802446.337118:0:14355:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788802446.337994:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d40c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.338019:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d40c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.338033:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d40c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.338117:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d405 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1aa expref: 21 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.338140:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d40c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1aa expref: 20 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.338149:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6c00) 00010000:00010000:2.0:1788802446.338153:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788802446.338156:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219ba00, rc 0) 00000100:00100000:2.0:1788802446.338932:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+20:14550:x1875694872292608:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 3962us (4776us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788802446.338944:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:2.0:1788802446.343576:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.344086:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872292864 00000100:00100000:0.0:1788802446.344100:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872292864 00000100:00100000:0.0:1788802446.344187:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:0.0:1788802446.344200:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d10d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+20:14550:x1875694872292864:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788802446.344318:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788802446.344359:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d40c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1aa expref: 20 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344412:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6c00) 00010000:00010000:0.0:1788802446.344430:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788802446.344465:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d41a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344483:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d41a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344496:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d41a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344513:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d421 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x30d9391f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344521:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d421 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30d9391f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344528:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d421 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30d9391f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344756:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d41a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344762:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d41a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344767:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d41a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344771:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802446.344775:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d41a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344785:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d41a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344792:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d02e21100) 00010000:00010000:0.0:1788802446.344794:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802446.344797:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d41a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344801:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d41a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344808:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d421 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30d9391f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344812:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d421 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30d9391f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344817:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d421 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30d9391f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344820:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802446.344821:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d421 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30d9391f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344824:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d421 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30d9391f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344827:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x30d9391f (ffff910d02db8c00) 00010000:00010000:0.0:1788802446.344829:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802446.344830:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d421 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x30d9391f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.344839:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d421 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x30d9391f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.345278:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d10d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+19:14550:x1875694872292864:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 746us (1384us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788802446.345289:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:0.0:1788802446.348387:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802446.348569:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872292992 00000100:00100000:2.0:1788802446.348584:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872292992 00000100:00100000:2.0:1788802446.348677:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:2.0:1788802446.348689:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+19:14550:x1875694872292992:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788802446.348718:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788802446.348749:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d428 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf1b1 expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.348796:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a000/0x6ecba1490fc9d42f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.348813:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a000/0x6ecba1490fc9d42f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.348829:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a000/0x6ecba1490fc9d42f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.348954:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d428 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b1 expref: 21 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.348977:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219a000/0x6ecba1490fc9d42f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b1 expref: 20 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.348988:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6600) 00010000:00010000:2.0:1788802446.348992:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788802446.348996:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910c0219a000, rc 0) 00000100:00100000:2.0:1788802446.349757:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+20:14550:x1875694872292992:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 1061us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802446.349768:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:1.0:1788802446.354834:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.354923:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872293248 00000100:00100000:0.0:1788802446.354935:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872293248 00000100:00100000:0.0:1788802446.355017:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:0.0:1788802446.355026:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+20:14550:x1875694872293248:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788802446.355137:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.355154:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.355169:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788802446.355793:0:14354:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788802446.355806:0:14354:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 499302567121ns, next at 500302564159ns, rc = 0 00000004:00010000:0.0:1788802446.355921:0:14354:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ad96a94 reply state 0000000008d8f765 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.355933:0:14354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788802446.356077:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+22:14550:x1875694872293248:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 1049us (1253us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788802446.356107:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00010000:00010000:3.0:1788802446.360367:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.360387:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.360394:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.360399:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802446.360404:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.360410:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.360429:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6600) 00010000:00010000:3.0:1788802446.360432:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788802446.360437:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.360444:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1800/0x6ecba1490fc9d436 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.360618:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802446.360768:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872293376 00000100:00100000:1.0:1788802446.360782:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872293376 00000100:00100000:1.0:1788802446.360856:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:1.0:1788802446.360868:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+21:14550:x1875694872293376:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788802446.360900:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802446.360921:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d43d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf1b8 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.361012:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d43d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b8 expref: 22 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.361027:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d43d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b8 expref: 22 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.361049:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6600) 00010000:00010000:1.0:1788802446.361052:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788802446.361055:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3e00, rc 0) 00000100:00100000:1.0:1788802446.361140:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+22:14550:x1875694872293376:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 275us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.361149:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:2.0:1788802446.365464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.365756:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872293504 00000100:00100000:3.0:1788802446.365770:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872293504 00000100:00080000:1.0:1788802446.366052:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788802446.366110:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788802446.366124:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+5:2359:x1875694872293504:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788802446.366904:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+6:2359:x1875694872293504:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 776us (1450us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788802446.366939:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:2.0:1788802446.378152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.378609:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872293760 00000100:00100000:0.0:1788802446.378623:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872293760 00000100:00100000:0.0:1788802446.379135:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788802446.379151:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+22:14550:x1875694872293760:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788802446.379541:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+23:14550:x1875694872293760:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 393us (1399us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788802446.379550:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788802446.383597:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802446.383736:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872294016 00000100:00100000:1.0:1788802446.383751:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872294016 00000100:00100000:1.0:1788802446.383861:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:1.0:1788802446.383875:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+23:14550:x1875694872294016:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788802446.384045:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+23:14550:x1875694872294016:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 173us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.384054:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:2.0:1788802446.389650:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.389853:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872294144 00000100:00100000:0.0:1788802446.389868:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872294144 00000100:00100000:0.0:1788802446.389963:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:0.0:1788802446.389978:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+23:14550:x1875694872294144:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802446.390008:0:16230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802446.390037:0:16230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d444 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf1bf expref: -99 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.390163:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d44b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.390181:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d44b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.390195:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d44b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788802446.390482:0:16230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788802446.390510:0:16230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d44b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.390545:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0200/0x6ecba1490fc9d444 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1bf expref: 25 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.390568:0:16230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d44b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1bf expref: 24 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.390578:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6600) 00010000:00010000:0.0:1788802446.390582:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788802446.390587:0:16230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1200, rc 0) 00000100:00100000:0.0:1788802446.390716:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+24:14550:x1875694872294144:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 741us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802446.390724:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:2.0:1788802446.395798:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.396003:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872294272 00000100:00100000:0.0:1788802446.396018:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872294272 00000100:00100000:0.0:1788802446.396130:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:0.0:1788802446.396143:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+6:2360:x1875694872294272:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802446.396178:0:15039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802446.396208:0:15039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9d452 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf1c6 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788802446.396299:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ef58e, blocks: 0x1 00010000:00010000:0.0:1788802446.396328:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788802446.396349:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802446.396360:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9d452 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1c6 expref: 7 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.396385:0:15039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9d452 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1c6 expref: 7 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.396401:0:15039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0600, rc 0) 00000100:00100000:0.0:1788802446.396486:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+7:2360:x1875694872294272:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 345us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802446.396493:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788802446.401027:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802446.403841:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872294528 00000100:00100000:1.0:1788802446.403876:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872294528 00000100:00100000:1.0:1788802446.405384:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:1.0:1788802446.405414:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+24:14550:x1875694872294528:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788802446.405605:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+24:14550:x1875694872294528:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 205us (4592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.405635:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 57 00000100:00100000:1.0:1788802446.409108:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802446.409302:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872294656 00000100:00100000:2.0:1788802446.409320:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872294656 00000100:00100000:2.0:1788802446.409400:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:2.0:1788802446.409414:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+24:14550:x1875694872294656:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788802446.506415:0:5865:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788802446.506507:0:5865:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788802446.506769:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+13:14550:x1875694872294656:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 97349us (97668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802446.506781:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 58 00000100:00100000:1.0:1788802446.509047:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788802446.509082:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892199424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788802446.509512:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788802446.513535:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892199424 00000100:00100000:3.0:1788802446.513560:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892199424 00000100:00100000:3.0:1788802446.513826:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788802446.513841:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875694892199424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788802446.514104:0:15038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788802446.514109:0:15038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788802446.514112:0:15038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788802446.514114:0:15038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788802446 -> 1788802446 00002000:00010000:3.0:1788802446.514116:0:15038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788802446.514588:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875694892199424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 749us (5074us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788802446.514600:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1788802446.515535:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff910d21a95880/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788802446.515548:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875694892199424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788802446.516560:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.516691:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872294784 00000100:00100000:0.0:1788802446.516702:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872294784 00000100:00100000:0.0:1788802446.516771:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:0.0:1788802446.516784:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+7:2360:x1875694872294784:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788802446.516934:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+7:2360:x1875694872294784:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 152us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802446.516942:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:2.0:1788802446.520615:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802446.520817:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872295040 00000100:00100000:1.0:1788802446.520832:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872295040 00000100:00100000:1.0:1788802446.520946:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:1.0:1788802446.520959:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+13:14550:x1875694872295040:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788802446.521035:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788802446.521074:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d44b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1bf expref: 13 pid: 16230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.521098:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6600) 00010000:00010000:1.0:1788802446.521105:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788802446.521143:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.521171:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.521183:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788802446.521658:0:14354:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0ae4183 reply state 00000000fac8fef5 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788802446.521884:0:14354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788802446.522085:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+14:14550:x1875694872295040:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 1126us (1482us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788802446.522092:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 59 00000100:00100000:2.0:1788802446.526166:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.527393:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872295168 00000100:00100000:0.0:1788802446.527412:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872295168 00000100:00100000:0.0:1788802446.527514:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:0.0:1788802446.527527:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+7:14550:x1875694872295168:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788802446.527553:0:15038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802446.527579:0:15038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf1cd expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.527648:0:15038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9d452 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1c6 expref: 8 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.527658:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802446.527884:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802446.527893:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 8 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.527940:0:15038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9d452 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1c6 expref: 8 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.527959:0:15038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9d452 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1c6 expref: 8 pid: 15039 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.527977:0:15038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15038:1875694892199552:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802446.528096:0:15038:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3eebecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788802446.529995:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.530020:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.530029:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.530036:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2e00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:3.0:1788802446.530043:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.530052:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.530100:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6600) 00010000:00010000:3.0:1788802446.530103:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788802446.530109:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.530117:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2e00/0x6ecba1490fc9d459 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.532831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.532970:0:15038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15038:1875694892199552:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802446.533015:0:15038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 8 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.533043:0:15038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f1800, rc 0) 00000100:00100000:3.0:1788802446.533125:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+8:14550:x1875694872295168:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 5599us (6980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802446.533135:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:2.0:1788802446.534068:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872295296 00000100:00100000:2.0:1788802446.534085:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872295296 00010000:00010000:2.0:1788802446.534137:0:14338:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9d452 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1c6 expref: 8 pid: 15039 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802446.534195:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:2.0:1788802446.534206:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:364c129c-855f-4ad1-8a13-12da787d546b+8:2359:x1875694872295296:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802446.534223:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802446.534305:0:14338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9d452 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1c6 expref: 8 pid: 15039 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.534348:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9d452 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1c6 expref: 8 pid: 15039 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.534379:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2a93428/0x6ecba1490fc9d452 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1c6 expref: 8 pid: 15039 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.534400:0:14338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802446.534405:0:14338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788802446.534413:0:14338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 7 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.534426:0:14338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 7 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.534482:0:14338:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 7 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802446.534500:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d21a93480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14338:1875694892199680:192.168.201.57@tcp:105: 00000100:00100000:2.0:1788802446.534596:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d10fd03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788802446.539811:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802446.539932:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d21a93480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14338:1875694892199680:192.168.201.57@tcp:105: 00010000:00010000:2.0:1788802446.539965:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802446.540046:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:364c129c-855f-4ad1-8a13-12da787d546b+7:2359:x1875694872295296:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 5840us (7230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802446.540083:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:1.0:1788802446.540217:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872295424 00000100:00100000:1.0:1788802446.540227:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872295424 00000100:00100000:1.0:1788802446.540670:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:1.0:1788802446.540684:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:364c129c-855f-4ad1-8a13-12da787d546b+7:2359:x1875694872295424:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788802446.540954:0:15037:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788802446.540959:0:15037:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788802446 00002000:00010000:1.0:1788802446.540962:0:15037:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788802444 00002000:00010000:1.0:1788802446.540964:0:15037:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788802446 -> 1788802446 00002000:00010000:1.0:1788802446.540967:0:15037:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788802446.541007:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:364c129c-855f-4ad1-8a13-12da787d546b+8:2359:x1875694872295424:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 326us (1213us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788802446.541014:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788802446.544026:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.544137:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872295552 00000100:00100000:0.0:1788802446.544163:0:15038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872295552 00000100:00100000:0.0:1788802446.544406:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:0.0:1788802446.544421:0:15038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+8:2358:x1875694872295552:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788802446.544494:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.544546:0:15038:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 8 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.544557:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802446.544562:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788802446.544568:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.544620:0:15038:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 8 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.544639:0:15038:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 8 pid: 15038 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.544659:0:15038:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15038:1875694892199808:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802446.544772:0:15038:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3eebeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788802446.548749:0:15038:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15038:1875694892199808:192.168.201.57@tcp:104: 00010000:00010000:3.0:1788802446.548795:0:15038:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802446.549172:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.549293:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872295680 00000100:00100000:3.0:1788802446.549302:0:14339:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872295680 00010000:00010000:3.0:1788802446.549348:0:14339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 9 pid: 15038 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802446.549418:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788802446.549444:0:14339:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:364c129c-855f-4ad1-8a13-12da787d546b+9:2360:x1875694872295680:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788802446.549465:0:14339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788802446.549498:0:14339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 9 pid: 15038 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.549512:0:14339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 9 pid: 15038 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.549540:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dbb561d/0x6ecba1490fc9d460 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1cd expref: 9 pid: 15038 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.549561:0:14339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788802446.549566:0:14339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788802446.549572:0:14339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.549584:0:14339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.549606:0:14339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788802446.549670:0:14339:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:364c129c-855f-4ad1-8a13-12da787d546b+8:2360:x1875694872295680:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 242us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802446.549678:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00010000:00010000:2.0:1788802446.551386:0:15038:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.551413:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.551561:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.551572:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.551583:0:15038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.551591:0:15038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0a00 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:2.0:1788802446.551597:0:15038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.551608:0:15038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.551631:0:15038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.551663:0:15038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e14c304/0x6ecba1490fc9d467 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802446.551848:0:15038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:364c129c-855f-4ad1-8a13-12da787d546b+7:2358:x1875694872295552:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 7425us (7832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802446.551860:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:2.0:1788802446.555738:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802446.555853:0:16230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872295936 00000100:00100000:0.0:1788802446.555868:0:16230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872295936 00000100:00100000:0.0:1788802446.555951:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 60 00000100:00100000:0.0:1788802446.555965:0:16230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+13:14550:x1875694872295936:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788802446.556079:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d46e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.556102:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d46e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.556142:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d46e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.556558:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.556574:0:16230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d43d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b8 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.556584:0:16230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.556633:0:16230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d43d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b8 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.556651:0:16230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d43d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b8 expref: 14 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.556669:0:16230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16230:1875694892199936:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788802446.556784:0:16230:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3eebe780 going to sleep for 11 seconds 00000100:00100000:1.0:1788802446.560518:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802446.560619:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872296064 00000100:00100000:2.0:1788802446.560631:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872296064 00010000:00010000:2.0:1788802446.560697:0:14338:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d43d lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b8 expref: 15 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802446.560749:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:2.0:1788802446.560761:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:364c129c-855f-4ad1-8a13-12da787d546b+15:2360:x1875694872296064:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788802446.560780:0:14338:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788802446.560788:0:14338:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d43d lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b8 expref: 15 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.560804:0:14338:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d43d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b8 expref: 15 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.560835:0:14338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6600) 00010000:00010000:2.0:1788802446.560843:0:14338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.560856:0:14338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.560886:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.560910:0:14338:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788802446.560975:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:364c129c-855f-4ad1-8a13-12da787d546b+15:2360:x1875694872296064:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 216us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802446.560983:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00010000:00010000:0.0:1788802446.561644:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3e00/0x6ecba1490fc9d43d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1b8 expref: 14 pid: 14355 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.561666:0:16230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16230:1875694892199936:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788802446.561700:0:16230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.561712:0:16230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.561728:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788802446.562008:0:16230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788802446.562189:0:16230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1788802446.562548:0:16230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1788802446.562669:0:16230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16230:1875694892200064:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788802446.562756:0:16230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802446.562926:0:16230:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3eebe900 going to sleep for 11 seconds 00000100:00100000:1.0:1788802446.564025:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892200064 00000100:00100000:1.0:1788802446.564041:0:14358:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892200064 00000100:00100000:1.0:1788802446.564149:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788802446.564171:0:14358:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d082ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16230:x1875694892200064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788802446.564552:0:14358:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d082ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16230:x1875694892200064:12345-0@lo:1000:mdt00_003.0 Request processed in 383us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802446.564561:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788802446.565132:0:16230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16230:1875694892200064:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788802446.566804:0:16230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788802446.566938:0:16230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d082eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16230:1875694892200192:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788802446.567036:0:16230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788802446.567076:0:16230:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3eebe780 going to sleep for 11 seconds 00000100:00100000:2.0:1788802446.567199:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694892200192 00000100:00100000:2.0:1788802446.567210:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694892200192 00000100:00100000:2.0:1788802446.567517:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788802446.567529:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16230:x1875694892200192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788802446.567790:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16230:x1875694892200192:12345-0@lo:1000:mdt00_003.0 Request processed in 264us (754us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788802446.567799:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788802446.568022:0:16230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d082eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16230:1875694892200192:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788802446.568069:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568080:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568089:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568096:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0000 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802446.568101:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568123:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568143:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6600) 00010000:00010000:0.0:1788802446.568147:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788802446.568220:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568370:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0000/0x6ecba1490fc9d475 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568420:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568427:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568512:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568517:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d3a0f2800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802446.568521:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568527:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568538:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d05184300) 00010000:00010000:0.0:1788802446.568540:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788802446.568549:0:16230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9d3d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf19c expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568576:0:16230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9d3d4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf19c expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568587:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9d3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf19c expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.568662:0:16230:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1400/0x6ecba1490fc9d3d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf19c expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788802446.568680:0:16230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff910d3a622d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16230:1875694892200320:192.168.201.57@tcp:105: 00000100:00100000:0.0:1788802446.568824:0:16230:0:(client.c:2716:ptlrpc_set_wait()) set ffff910d3eebe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788802446.572284:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.572351:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872296192 00000100:00100000:3.0:1788802446.572364:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872296192 00000100:00100000:3.0:1788802446.572442:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788802446.572454:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:364c129c-855f-4ad1-8a13-12da787d546b+18:14549:x1875694872296192:12345-192.168.201.57@tcp:49:bash.0 00000100:00100000:0.0:1788802446.572705:0:16230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff910d3a622d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16230:1875694892200320:192.168.201.57@tcp:105: 00010000:00010000:0.0:1788802446.572741:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572753:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f2800/0x6ecba1490fc9d3cd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572794:0:16230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d47c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572811:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d47c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572825:0:16230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d47c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572838:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d47c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572861:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d47c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572868:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d47c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572875:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f1200 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802446.572880:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d47c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572889:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d47c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572904:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d05184300) 00010000:00010000:0.0:1788802446.572908:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788802446.572913:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d47c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572918:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f1200/0x6ecba1490fc9d47c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572928:0:16230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d46e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572934:0:16230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d46e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572940:0:16230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d46e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572945:0:16230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d206f0600 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:0.0:1788802446.572954:0:16230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d46e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572961:0:16230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d46e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572970:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d05184300) 00010000:00010000:0.0:1788802446.572973:0:16230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788802446.572976:0:16230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d46e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.572982:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d206f0600/0x6ecba1490fc9d46e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788802446.573648:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:364c129c-855f-4ad1-8a13-12da787d546b+18:14549:x1875694872296192:12345-192.168.201.57@tcp:49:bash.0 Request processed in 1190us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788802446.573661:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000040:00080000:3.0:1788802446.573838:0:14387:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788802446.573844:0:14387:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788802446.573874:0:14387:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788802446.573881:0:14387:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788802446.574745:0:16230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:364c129c-855f-4ad1-8a13-12da787d546b+17:14550:x1875694872295936:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 18773us (19013us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788802446.574761:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 60 00000020:00080000:0.0:1788802446.574771:0:16230:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788802446.579840:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802446.579993:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.580865:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872296448 00000100:00100000:3.0:1788802446.580883:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872296448 00000100:00100000:3.0:1788802446.580973:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:3.0:1788802446.580987:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:364c129c-855f-4ad1-8a13-12da787d546b+17:14550:x1875694872296448:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788802446.582326:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872296576 00000100:00100000:0.0:1788802446.582339:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872296576 00000100:00100000:0.0:1788802446.582396:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:0.0:1788802446.582406:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+7:14549:x1875694872296576:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788802446.582423:0:15039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788802446.582464:0:15039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9d483 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf1d4 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788802446.582494:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9ef58e, atime: 0x6a9ef58c, ctime: 0x6a9ef58e, blocks: 0x1 00010000:00010000:0.0:1788802446.582519:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1788802446.582525:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788802446.582545:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9d483 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1d4 expref: 8 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.582566:0:15039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000029dbded2/0x6ecba1490fc9d483 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1d4 expref: 8 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.582581:0:15039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d206f0200, rc 0) 00000100:00100000:0.0:1788802446.582655:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+8:14549:x1875694872296576:12345-192.168.201.57@tcp:101:bash.0 Request processed in 251us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802446.582662:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000004:00080000:3.0:1788802446.583436:0:14356:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788802446.583642:0:14356:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1788802446.583722:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.583739:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.583752:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.583762:0:14356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.583782:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.583789:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788802446.583821:0:14356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788802446.583925:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:364c129c-855f-4ad1-8a13-12da787d546b+19:14550:x1875694872296448:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 2936us (4100us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1788802446.583935:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000020:00080000:3.0:1788802446.583941:0:14356:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788802446.584109:0:14341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788802446.584117:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.584125:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910d01681200 already unused, calling callback (ffffffffc17338b0) 00010000:00010000:0.0:1788802446.584129:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.584138:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.584154:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff910d157d6600) 00010000:00010000:0.0:1788802446.584168:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788802446.584174:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.584181:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d01681200/0x6ecba1490fc9d48a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788802446.584197:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802446.584206:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802446.584208:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802446.591652:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.592015:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872296832 00000100:00100000:3.0:1788802446.592031:0:14357:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872296832 00000100:00100000:3.0:1788802446.592161:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:3.0:1788802446.592176:0:14357:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+19:14549:x1875694872296832:12345-192.168.201.57@tcp:35:bash.0 00000001:00080000:3.0:1788802446.592661:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:3.0:1788802446.592812:0:14357:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:364c129c-855f-4ad1-8a13-12da787d546b+21:14549:x1875694872296832:12345-192.168.201.57@tcp:35:bash.0 Request processed in 637us (1173us total) trans 8589934632 rc 0/0 00000100:00100000:3.0:1788802446.592821:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000020:00080000:3.0:1788802446.592827:0:14357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788802446.709935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802446.711332:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872297088 00000100:00100000:1.0:1788802446.711352:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872297088 00000100:00100000:1.0:1788802446.712050:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:1.0:1788802446.712070:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+21:14560:x1875694872297088:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:1.0:1788802446.712398:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788802446.712574:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3a00/0x6ecba1490fc9d491 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6d80875826edf1db expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788802446.712707:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788802446.713009:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3a00/0x6ecba1490fc9d491 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1db expref: 23 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.713027:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff910d157d6f00) 00010000:00010000:1.0:1788802446.713031:0:14353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788802446.713037:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910d3a0f3a00/0x6ecba1490fc9d491 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x6d80875826edf1db expref: 23 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788802446.713058:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff910d3a0f3a00, rc 0) 00000100:00100000:1.0:1788802446.713297:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:364c129c-855f-4ad1-8a13-12da787d546b+22:14560:x1875694872297088:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1168us (3313us total) trans 8589934633 rc 301/301 00000100:00100000:1.0:1788802446.713310:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 61 00000100:00100000:1.0:1788802446.717969:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788802446.718750:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872297216 00000100:00100000:2.0:1788802446.718766:0:14355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872297216 00000100:00100000:2.0:1788802446.718862:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:2.0:1788802446.718876:0:14355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d21a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+22:14560:x1875694872297216:12345-192.168.201.57@tcp:34:lfs.0 00010000:00010000:2.0:1788802446.718986:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d49f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.719010:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d49f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.719024:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d49f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.719063:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d4a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.719072:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.719079:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.719918:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.719933:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.719942:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788802446.720002:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720019:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d49f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720026:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d49f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720034:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d49f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720041:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219b800 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802446.720046:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d49f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720063:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d49f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720078:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff910d02e21100) 00010000:00010000:2.0:1788802446.720082:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802446.720089:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d49f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720108:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219b800/0x6ecba1490fc9d49f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720124:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720130:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d4a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720136:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720141:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219ba00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802446.720144:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720149:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720639:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff910d157d6000) 00010000:00010000:2.0:1788802446.720643:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802446.720647:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d4a6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720669:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ba00/0x6ecba1490fc9d4a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720688:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720695:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720701:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720707:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff910c0219ac00 already unused, calling callback (ffffffffc218e4f0) 00010000:00010000:2.0:1788802446.720710:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720717:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720726:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff910d05184300) 00010000:00010000:2.0:1788802446.720728:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788802446.720732:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788802446.720738:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff910c0219ac00/0x6ecba1490fc9d4ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788802446.720897:0:14355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d21a95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:364c129c-855f-4ad1-8a13-12da787d546b+22:14560:x1875694872297216:12345-192.168.201.57@tcp:34:lfs.0 Request processed in 2018us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802446.720909:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 62 00000100:00100000:0.0:1788802446.724685:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802446.724774:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872297472 00000100:00100000:3.0:1788802446.724791:0:14356:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872297472 00000100:00100000:3.0:1788802446.724871:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788802446.724883:0:14356:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:364c129c-855f-4ad1-8a13-12da787d546b+22:14560:x1875694872297472:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788802446.725579:0:14356:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:364c129c-855f-4ad1-8a13-12da787d546b+23:14560:x1875694872297472:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 693us (906us total) trans 8589934634 rc 0/0 00000100:00100000:3.0:1788802446.725590:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00010000:00010000:0.0:1788802446.988732:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788802448.019628:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788802448.554906:0:16618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1788802449.038455:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802449.405617:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802449.405674:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802449.405713:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802449.405755:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802449.405779:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802449.405800:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802449.405827:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788802449.405999:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872297728 00000100:00100000:0.0:1788802449.406013:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872297728 00000100:00100000:0.0:1788802449.406099:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872298112 00000100:00100000:0.0:1788802449.406103:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872298112 00000100:00100000:0.0:1788802449.406148:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:0.0:1788802449.406161:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d41e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+23:2358:x1875694872297728:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802449.406324:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d41e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:364c129c-855f-4ad1-8a13-12da787d546b+23:2358:x1875694872297728:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 165us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802449.406333:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:0.0:1788802449.406355:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:0.0:1788802449.406362:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5da259-4b74-472e-93fb-705207586f21+6:2358:x1875694872298112:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802449.406394:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df5da259-4b74-472e-93fb-705207586f21+6:2358:x1875694872298112:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 32us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802449.406401:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:0.0:1788802449.406423:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872297856 00000100:00100000:0.0:1788802449.406426:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872297856 00000100:00100000:0.0:1788802449.406447:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872297984 00000100:00100000:0.0:1788802449.406450:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872297984 00000100:00100000:0.0:1788802449.406461:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872298240 00000100:00100000:0.0:1788802449.406463:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872298240 00000100:00100000:0.0:1788802449.406474:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872298368 00000100:00100000:0.0:1788802449.406476:0:15039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872298368 00000100:00100000:0.0:1788802449.406491:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788802449.406497:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d3a093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+8:2358:x1875694872297856:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788802449.406610:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d3a093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+8:2358:x1875694872297856:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 112us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802449.406617:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788802449.406631:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788802449.406637:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+5:2356:x1875694872297984:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:0.0:1788802449.406662:0:15039:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9d142 00000100:00080000:0.0:1788802449.406682:0:15039:0:(import.c:65:import_set_state_nolock()) ffff910c02b69800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788802449.406751:0:15039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788802449.407054:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:364c129c-855f-4ad1-8a13-12da787d546b+2:2356:x1875694872297984:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 415us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802449.407062:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788802449.407076:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788802449.407083:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+5:2356:x1875694872298240:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:0.0:1788802449.407096:0:15039:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9d173 00000100:00080000:0.0:1788802449.407106:0:15039:0:(import.c:65:import_set_state_nolock()) ffff910d037d6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788802449.407133:0:15039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934597 00000100:00100000:0.0:1788802449.407298:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+2:2356:x1875694872298240:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 214us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802449.407305:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:0.0:1788802449.407321:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788802449.407330:0:15039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+5:2356:x1875694872298368:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:0.0:1788802449.407346:0:15039:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6ecba1490fc9d17a 00000100:00080000:0.0:1788802449.407352:0:15039:0:(import.c:65:import_set_state_nolock()) ffff910d037d4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788802449.407368:0:15039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788802449.407473:0:15039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df5da259-4b74-472e-93fb-705207586f21+2:2356:x1875694872298368:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 144us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788802449.407481:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00010000:00010000:0.0:1788802449.407502:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788802449.407511:0:14342:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788802449.407523:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872297600 00000100:00100000:2.0:1788802449.407531:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872297600 00000100:00100000:2.0:1788802449.407572:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 122 00000100:00100000:2.0:1788802449.407581:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d35888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:2358:x1875694872297600:12345-192.168.201.57@tcp:400:kworker.0 00000100:00080000:3.0:1788802449.407638:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788802449.407645:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788802449.407648:0:14349:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788802449.408718:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d35888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b2e0225-aaaf-4b10-912e-97a2922a7720+13:2358:x1875694872297600:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 1129us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788802449.408748:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 122 00010000:00010000:0.0:1788802450.076021:0:14341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788802450.434965:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788802450.435023:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788802450.435300:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872298624 00000100:00100000:1.0:1788802450.435317:0:15037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872298624 00000100:00100000:1.0:1788802450.435399:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:1.0:1788802450.435431:0:15037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:364c129c-855f-4ad1-8a13-12da787d546b+8:2357:x1875694872298624:12345-192.168.201.57@tcp:16:kworker.0 00000100:00100000:1.0:1788802450.435623:0:15037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:364c129c-855f-4ad1-8a13-12da787d546b+8:2357:x1875694872298624:12345-192.168.201.57@tcp:16:kworker.0 Request processed in 195us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788802450.435632:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:2.0:1788802450.441292:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875694872298496 00000100:00100000:2.0:1788802450.441314:0:15043:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875694872298496 00002000:00100000:2.0:1788802450.441387:0:15043:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff910d33db6a00 x1875694872298496/t0(0) o4->364c129c-855f-4ad1-8a13-12da787d546b@192.168.201.57@tcp:591/0 lens 504/0 e 0 to 0 dl 1788802461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788802450.441399:0:15043:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d33db6a00 with x1875694872298496 ext(0->8) 00002000:00010000:2.0:1788802450.441407:0:15043:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff910d33db6a00 00000100:00100000:2.0:1788802450.441455:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:2.0:1788802450.441468:0:15043:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff910d33db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:364c129c-855f-4ad1-8a13-12da787d546b+8:2357:x1875694872298496:12345-192.168.201.57@tcp:4:bash.0 00000100:00100000:0.0:1788802450.445894:0:15043:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff910d33db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:364c129c-855f-4ad1-8a13-12da787d546b+10:2357:x1875694872298496:12345-192.168.201.57@tcp:4:bash.0 Request processed in 4411us (10930us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788802450.445918:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00002000:00100000:0.0:1788802450.445935:0:15043:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff910d33db6a00 x1875694872298496/t8589934598(0) o4->364c129c-855f-4ad1-8a13-12da787d546b@192.168.201.57@tcp:591/0 lens 504/448 e 0 to 0 dl 1788802461 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788802450.445948:0:15043:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff910d33db6a00 with x1875694872298496 ext(0->8) 00002000:00010000:0.0:1788802450.445956:0:15043:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff910d33db6a00 Debug log: 29807 lines, 29807 kept, 0 dropped, 0 bad.